[ 525.203332] env[66428]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 525.203332] env[66428]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 526.231813] env[66519]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 526.231813] env[66519]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 527.862092] env[66519]: INFO neutron.common.config [-] Logging enabled! [ 527.862547] env[66519]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev40 [ 527.862737] env[66519]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=66519) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 527.863086] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 527.863185] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 527.864069] env[66519]: WARNING oslo_policy.policy [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 527.864283] env[66519]: WARNING oslo_policy.policy [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 527.866082] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] VMware NSXv3 Agent initialized successfully. [ 527.866424] env[66519]: DEBUG oslo_concurrency.lockutils [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] Acquiring lock "singleton_lock" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.866515] env[66519]: DEBUG oslo_concurrency.lockutils [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] Acquired lock "singleton_lock" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.866725] env[66519]: DEBUG oslo_concurrency.lockutils [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] Releasing lock "singleton_lock" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.867115] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] Full set of CONF: {{(pid=66519) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 527.867223] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ******************************************************************************** {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 527.867350] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] Configuration options gathered from: {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 527.867731] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 527.867931] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 527.868048] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ================================================================================ {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 527.868226] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] agent_down_time = 75 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.868353] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] allow_automatic_dhcp_failover = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.868487] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] allow_bulk = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.868634] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] api_extensions_path = {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.868769] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] api_paste_config = api-paste.ini {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.868902] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] auth_strategy = keystone {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.869010] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] backdoor_port = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.869110] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] backdoor_socket = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.869241] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] backlog = 4096 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.869370] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] base_mac = fa:16:3e:00:00:00 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.869522] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] bind_host = 0.0.0.0 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.869658] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] bind_port = 9696 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.869783] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] client_socket_timeout = 900 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.869916] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] config_dir = [] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.870347] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.870541] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] config_source = [] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.870693] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] control_exchange = neutron {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.870833] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] core_plugin = ml2 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.870971] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] debug = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.871119] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] default_availability_zones = [] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.871323] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.871457] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] dhcp_agent_notification = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.871592] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] dhcp_agents_per_network = 1 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.871724] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] dhcp_lease_duration = 86400 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.871940] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] dhcp_load_type = networks {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.872152] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] dns_domain = openstacklocal {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.872308] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.872444] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] enable_default_route_bfd = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.872573] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] enable_default_route_ecmp = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.872699] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] enable_dvr = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.872826] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] enable_new_agents = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.872953] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.873112] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] enable_signals = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.873271] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] enable_traditional_dhcp = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.873435] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] external_dns_driver = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.873560] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] filter_validation = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.873703] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] global_physnet_mtu = 8950 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.873833] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] graceful_shutdown_timeout = 60 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.874022] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] host = cpu-1 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.874162] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] host_dvr_for_dhcp = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.874291] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] http_retries = 3 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.874441] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] instance_format = [instance: %(uuid)s] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.874582] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.874713] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ipam_driver = internal {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.874839] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ipv6_pd_enabled = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.874962] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] l3_ha = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.875106] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.875238] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] l3_ha_network_physical_name = {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.875366] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] l3_ha_network_type = {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.875499] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] log_color = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.875629] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] log_config_append = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.875793] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.875938] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] log_dir = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.876080] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] log_file = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.876183] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] log_options = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.876314] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] log_rotate_interval = 1 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.876454] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] log_rotate_interval_type = days {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.876592] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] log_rotation_type = none {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.876694] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.876792] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.876927] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.877069] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.877170] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.877299] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] max_dns_nameservers = 5 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.877426] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] max_header_line = 16384 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.877555] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] max_l3_agents_per_router = 3 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.877680] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] max_logfile_count = 30 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.877803] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] max_logfile_size_mb = 200 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.877928] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] max_subnet_host_routes = 20 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.878070] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] my_ip = 10.180.1.21 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.878204] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] my_ipv6 = ::1 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.878399] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] network_auto_schedule = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.878533] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] network_link_prefix = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.878667] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.878802] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] notify_nova_on_port_data_changes = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.878954] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] notify_nova_on_port_status_changes = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.879132] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] pagination_max_limit = -1 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.879286] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] publish_errors = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.879434] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] rate_limit_burst = 0 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.879596] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] rate_limit_except_level = CRITICAL {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.879744] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] rate_limit_interval = 0 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.879925] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] retry_until_window = 30 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.880097] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] router_distributed = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.880245] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] rpc_resources_processing_step = 20 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.880378] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] rpc_response_max_timeout = 600 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.880512] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] rpc_response_timeout = 60 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.880639] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] send_events_interval = 2 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.880786] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] service_plugins = ['router'] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.880919] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] setproctitle = on {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.881054] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] shell_completion = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.881193] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] state_path = /opt/stack/data/neutron {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.881324] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] syslog_log_facility = LOG_USER {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.881453] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] tcp_keepidle = 600 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.881583] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] transport_url = **** {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.881727] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] use_journal = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.881881] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] use_json = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.882038] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] use_ssl = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.882189] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] use_stderr = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.882343] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] use_syslog = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.882486] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] vlan_qinq = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.882614] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] vlan_transparent = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.882752] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] watch_log_file = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.882905] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] wsgi_default_pool_size = 100 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.883051] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] wsgi_keep_alive = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.883190] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.883316] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] wsgi_server_debug = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.883499] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_concurrency.disable_process_locking = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.883658] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.883819] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.883972] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.884135] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.884274] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.884410] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.884560] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] profiler.connection_string = messaging:// {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.884694] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] profiler.enabled = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.884831] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] profiler.es_doc_type = notification {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.884960] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] profiler.es_scroll_size = 10000 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.885107] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] profiler.es_scroll_time = 2m {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.885237] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] profiler.filter_error_trace = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.885383] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] profiler.hmac_keys = **** {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.885540] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] profiler.sentinel_service_name = mymaster {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.885812] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] profiler.socket_timeout = 0.1 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.885974] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] profiler.trace_requests = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.886147] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] profiler.trace_sqlalchemy = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.886326] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] profiler_jaeger.process_tags = {} {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.886490] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] profiler_jaeger.service_name_prefix = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.886670] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] profiler_otlp.service_name_prefix = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.886833] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_policy.enforce_new_defaults = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.887126] env[66519]: WARNING oslo_config.cfg [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 527.887275] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_policy.enforce_scope = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.887417] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_policy.policy_default_rule = default {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.887571] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.887711] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.887874] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.888035] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.888197] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.888348] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.888499] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.888644] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_policy.remote_timeout = 60.0 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.888809] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.888977] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] agent.extensions = [] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.889135] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.889278] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] service_providers.service_provider = [] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.889418] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] QUOTAS.default_quota = -1 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.889578] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.889740] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] QUOTAS.quota_floatingip = 50 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.889894] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] QUOTAS.quota_network = 100 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.890039] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] QUOTAS.quota_port = 500 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.890173] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.890303] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] QUOTAS.quota_router = 10 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.890433] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] QUOTAS.quota_security_group = 10 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.890562] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.890689] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] QUOTAS.quota_subnet = 100 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.890819] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] QUOTAS.track_quota_usage = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.890965] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.891106] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep.group = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.891235] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep.helper_command = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.891369] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep.log_daemon_traceback = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.891507] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.891666] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep.thread_pool_size = 8 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.891818] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep.user = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.891975] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.892113] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_dhcp_release.group = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.892243] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_dhcp_release.helper_command = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.892373] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.892506] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.892658] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.892794] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_dhcp_release.user = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.892935] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.893074] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_ovs_vsctl.group = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.893205] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_ovs_vsctl.helper_command = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.893334] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.893491] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.893631] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.893760] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_ovs_vsctl.user = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.893893] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_namespace.capabilities = [21] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.894028] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_namespace.group = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.894157] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_namespace.helper_command = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.894284] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_namespace.log_daemon_traceback = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.894437] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.894581] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_namespace.thread_pool_size = 8 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.894710] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_namespace.user = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.894847] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_conntrack.capabilities = [12] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.894973] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_conntrack.group = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.895112] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_conntrack.helper_command = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.895241] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.895376] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.895525] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.895673] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_conntrack.user = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.895817] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_link.capabilities = [12, 21] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.895944] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_link.group = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.896082] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_link.helper_command = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.896214] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_link.log_daemon_traceback = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.896348] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.896477] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_link.thread_pool_size = 8 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.896601] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] privsep_link.user = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.896752] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.896896] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.897037] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.continue_on_failed_promotions = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.897168] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.dscp = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.897301] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.dscp_inherit = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.897438] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.force_mp_to_policy = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.897566] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.locking_coordinator_url = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.897696] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.log_agent_heartbeats = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.897825] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.logging_expire = 1 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.897964] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.898112] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.898253] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.polling_interval = 240 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.898387] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.898532] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.898732] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.report_interval = 30.0 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.898888] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.899039] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.899182] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.899318] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.sync_skew = 60 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.899451] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.synchronization_queue_size = 20 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.899585] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT.use_helper_for_ns_read = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.899722] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] SECURITYGROUP.enable_ipset = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.899864] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] SECURITYGROUP.enable_security_group = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.899998] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.900148] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.900288] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] experimental.ipv6_pd_enabled = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.900441] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ml2.extension_drivers = ['port_security'] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.900573] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ml2.external_network_type = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.900717] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.900858] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ml2.overlay_ip_version = 4 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.900996] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ml2.path_mtu = 8950 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.901148] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ml2.physical_network_mtus = {} {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.901291] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ml2.tenant_network_types = ['vlan'] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.901447] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.901627] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ml2.type_drivers = ['vlan'] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.901793] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT_CLI.neutron_port_id = [] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.901945] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.902095] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.902239] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.902379] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.902514] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.902972] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.902972] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.902972] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.903154] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.903270] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_login_password = **** {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.903414] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_login_port = 443 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.903565] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_login_user = admin {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.903704] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.903843] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.903975] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.904134] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.904296] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.904465] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.904611] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.904746] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.904878] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.905025] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.905171] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.905304] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.905440] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.905635] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.905777] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] vsphere.vsphere_login_password = VMware1! {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.905907] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.906046] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.906183] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] nova.auth_section = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.906324] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] nova.auth_type = password {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.906460] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.906590] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] nova.certfile = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.906720] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] nova.collect_timing = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.906860] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] nova.endpoint_type = public {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.906991] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] nova.insecure = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.907131] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] nova.keyfile = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.907267] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] nova.region_name = RegionOne {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.907398] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] nova.split_loggers = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.907527] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] nova.timeout = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.907660] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] placement.auth_section = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.907796] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] placement.auth_type = password {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.907928] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.908065] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] placement.certfile = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.908196] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] placement.collect_timing = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.908329] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] placement.endpoint_type = public {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.908455] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] placement.insecure = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.908580] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] placement.keyfile = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.908703] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] placement.region_name = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.908831] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] placement.split_loggers = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.908950] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] placement.timeout = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.909091] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.auth_section = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.909218] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.auth_type = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.909341] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.cafile = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.909464] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.certfile = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.909595] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.collect_timing = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.909719] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.connect_retries = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.909841] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.connect_retry_delay = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.909967] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.enable_notifications = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.910098] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.endpoint_override = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.910227] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.insecure = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.910353] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.interface = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.910479] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.keyfile = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.910612] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.max_version = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.910736] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.min_version = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.910862] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.region_name = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.910984] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.retriable_status_codes = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.911118] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.service_name = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.911240] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.service_type = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.911365] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.split_loggers = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.911496] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.status_code_retries = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.911630] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.status_code_retry_delay = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.911757] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.timeout = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.911886] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.valid_interfaces = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.912016] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ironic.version = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.912155] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] cli_script.dry_run = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.912299] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.912430] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.912560] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.912688] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.912817] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.912944] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.913082] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.913214] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.913341] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.913511] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.913639] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.913779] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.913930] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.914096] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.914250] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.914404] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.914546] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.914677] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.914815] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.914945] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.915087] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.915216] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.915342] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.915469] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.915596] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.915723] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.915846] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.915973] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.916111] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.916239] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.916366] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.ssl = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.916502] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.916637] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.916765] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.916895] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.917035] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.ssl_version = {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.917166] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.917303] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_notifications.driver = [] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.917433] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_notifications.retry = -1 {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.917577] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.917705] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] oslo_messaging_notifications.transport_url = **** {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.917804] env[66519]: DEBUG oslo_service.backend._eventlet.service [None req-e7566720-9e0a-4495-b35f-1e6a99a05d52 None None] ******************************************************************************** {{(pid=66519) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 527.918986] env[66519]: DEBUG neutron.agent.securitygroups_rpc [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Init firewall settings (driver=nsxv3) {{(pid=66519) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 527.920424] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=66519) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 527.920690] env[66519]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] RPC agent_id: nsxm-l-01a.corp.local [ 527.923744] env[66519]: DEBUG dogpile.cache.region [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 527.923744] env[66519]: DEBUG dogpile.lock [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 527.923744] env[66519]: DEBUG dogpile.lock [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 527.923744] env[66519]: DEBUG dogpile.lock [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 527.923744] env[66519]: DEBUG dogpile.cache.region [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 527.923744] env[66519]: DEBUG dogpile.lock [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 527.923744] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 527.987915] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Session token - acquiring [ 527.989431] env[66519]: DEBUG networking_nsxv3.common.locking [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.989673] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.989721] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.990207] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.001639] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.300151] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 528.325838] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 528.326074] env[66519]: DEBUG dogpile.cache.region [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Cache value generated in 0.402 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 528.326131] env[66519]: DEBUG dogpile.lock [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 528.326240] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Activating Policy API Provider. [ 528.326436] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Looking for the default Infrastructure Rules. [ 528.403058] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Looking for the Default Layer3 Logged Drop Section. [ 528.422817] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 528.423300] env[66519]: DEBUG networking_nsxv3.common.locking [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.423529] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquiring lock "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.423644] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquired lock "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.423980] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquired external semaphore "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.424336] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 528.940986] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 529.443236] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 529.945868] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Inventory metadata is going to be refreshed. [ 529.946351] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 530.784564] env[66519]: DEBUG networking_nsxv3.common.locking [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.784817] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.784924] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.785192] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.797756] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 530.798666] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.799309] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 530.818355] env[66519]: DEBUG networking_nsxv3.common.locking [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.818566] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.818633] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.818919] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.819055] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.819198] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 530.819309] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.819408] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 530.841185] env[66519]: DEBUG networking_nsxv3.common.locking [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.841450] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.841450] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.841889] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.842132] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.842341] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 530.864857] env[66519]: DEBUG networking_nsxv3.common.locking [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.865184] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.865184] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.865422] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.865567] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.865718] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 530.888627] env[66519]: DEBUG networking_nsxv3.common.locking [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.888861] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquiring lock "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.888990] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquired lock "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.889244] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquired external semaphore "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.889382] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Releasing lock "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.889542] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 530.889639] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.889738] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 530.909030] env[66519]: DEBUG networking_nsxv3.common.locking [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.909304] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquiring lock "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.909421] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquired lock "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.909616] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquired external semaphore "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.909739] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Releasing lock "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.909881] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 530.909981] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.910099] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 530.931877] env[66519]: DEBUG networking_nsxv3.common.locking [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.932124] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.932197] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.932446] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.932643] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.932809] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 530.932911] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.933012] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Inventory metadata have been refreshed. [ 530.933109] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Dryrun:True. Metadata refresh completed. [ 530.933222] env[66519]: DEBUG oslo_concurrency.lockutils [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Releasing lock "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.935272] env[66519]: INFO neutron.agent.agent_extensions_manager [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Loaded agent extensions: [] [ 530.936045] env[66519]: DEBUG neutron_lib.callbacks.manager [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=66519) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 530.988432] env[66519]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] NSXv3 Agent Agent RPC Daemon Started! [ 530.988798] env[66519]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] NSXv3 Agent Agent loop - iteration:0 started [ 530.988798] env[66519]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] NSXv3 Agent Agent out of sync with plugin! [ 535.936322] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 535.936662] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 540.937353] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 540.937890] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 543.940587] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.940587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.940587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.940587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.940587] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 544.444423] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 544.945600] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 545.447997] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 545.448219] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 545.938461] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 545.938634] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 546.246630] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.247037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.247037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.247196] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 546.260079] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 546.260993] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.261771] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 546.265021] env[66519]: INFO networking_nsxv3.common.synchronization [None req-b1e651e7-c49a-4e8b-ac8d-bea5d26d85af demo admin] Enqueued Resource ID: 0efca2f8-22fa-4235-b9e0-9321ea74262b with Priority: HIGHEST for action security_group_rules [ 546.265543] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0efca2f8-22fa-4235-b9e0-9321ea74262b with Priority: HIGHEST for action security_group_rules [ 546.265850] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0efca2f8-22fa-4235-b9e0-9321ea74262b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.265970] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0efca2f8-22fa-4235-b9e0-9321ea74262b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.266215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0efca2f8-22fa-4235-b9e0-9321ea74262b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.266493] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0efca2f8-22fa-4235-b9e0-9321ea74262b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 546.266585] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0efca2f8-22fa-4235-b9e0-9321ea74262b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 546.282861] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.283180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.283180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.283414] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 546.283505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.283620] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 546.283716] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 546.283785] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 546.308204] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.308433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.308433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.308608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 546.308744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.308858] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 546.333023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.333269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.333269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.333482] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 546.333589] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.333756] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 546.358427] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.358669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.358669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.358843] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 546.358948] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.359083] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 546.359157] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 546.359238] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 546.381614] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.381858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.381858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.382021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 546.382121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.382232] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 546.382306] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 546.382371] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 546.404258] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.404501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.404501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.404663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 546.404815] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.404944] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 546.405029] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 546.405100] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 546.405165] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 546.405239] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 546.405300] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 546.405361] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 546.405619] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 546.405684] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 546.405754] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 546.427883] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.428154] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.428154] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.428308] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 546.428414] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.428525] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 546.455218] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.455460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.455460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.455632] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 546.455732] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.491337] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.787923] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 546.788210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 546.788210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 546.788281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 546.788355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.788447] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0efca2f8-22fa-4235-b9e0-9321ea74262b already deleted. [ 546.788530] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0efca2f8-22fa-4235-b9e0-9321ea74262b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.267689] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 551.267689] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 556.267694] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 556.267974] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 561.268788] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 561.269179] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 566.269878] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 566.269878] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 571.271292] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 571.271600] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 572.162329] env[66519]: INFO networking_nsxv3.common.synchronization [None req-cb823d19-353e-4986-a813-420dcaba11c5 None None] Enqueued Resource ID: 18cf576e-245e-40b8-bcf5-8ac5763987a1 with Priority: HIGHEST for action port [ 572.162329] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18cf576e-245e-40b8-bcf5-8ac5763987a1 with Priority: HIGHEST for action port [ 572.162329] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-18cf576e-245e-40b8-bcf5-8ac5763987a1 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.162329] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18cf576e-245e-40b8-bcf5-8ac5763987a1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.162329] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18cf576e-245e-40b8-bcf5-8ac5763987a1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.162329] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18cf576e-245e-40b8-bcf5-8ac5763987a1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.162329] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18cf576e-245e-40b8-bcf5-8ac5763987a1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.663700] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18cf576e-245e-40b8-bcf5-8ac5763987a1 [ 572.663979] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.664237] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.664237] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.664436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.664524] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.664618] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18cf576e-245e-40b8-bcf5-8ac5763987a1 already deleted. [ 572.664697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18cf576e-245e-40b8-bcf5-8ac5763987a1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.251134] env[66519]: INFO networking_nsxv3.common.synchronization [None req-20208bb6-f9da-42e0-bfcd-794dc586800e None None] Enqueued Resource ID: dde77307-aa42-4979-80d1-8280909a080f with Priority: HIGHEST for action port [ 574.251134] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dde77307-aa42-4979-80d1-8280909a080f with Priority: HIGHEST for action port [ 574.251134] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-dde77307-aa42-4979-80d1-8280909a080f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.251134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dde77307-aa42-4979-80d1-8280909a080f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.251134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dde77307-aa42-4979-80d1-8280909a080f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.251134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dde77307-aa42-4979-80d1-8280909a080f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.251134] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dde77307-aa42-4979-80d1-8280909a080f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.754312] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dde77307-aa42-4979-80d1-8280909a080f [ 574.754600] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.754741] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.754811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.755066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.755231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.755279] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dde77307-aa42-4979-80d1-8280909a080f already deleted. [ 574.755346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dde77307-aa42-4979-80d1-8280909a080f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.765377] env[66519]: INFO networking_nsxv3.common.synchronization [None req-3c167aed-d3db-428c-ab90-cded5044244a None None] Enqueued Resource ID: 149ab387-d0f9-469a-929d-5210ce14f2f1 with Priority: HIGHEST for action port [ 576.765918] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 149ab387-d0f9-469a-929d-5210ce14f2f1 with Priority: HIGHEST for action port [ 576.766122] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-149ab387-d0f9-469a-929d-5210ce14f2f1 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.766248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-149ab387-d0f9-469a-929d-5210ce14f2f1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.766311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-149ab387-d0f9-469a-929d-5210ce14f2f1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.766570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-149ab387-d0f9-469a-929d-5210ce14f2f1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.766684] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('149ab387-d0f9-469a-929d-5210ce14f2f1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.270473] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 149ab387-d0f9-469a-929d-5210ce14f2f1 [ 577.270619] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.270790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.270790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.270971] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.271084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.271188] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:149ab387-d0f9-469a-929d-5210ce14f2f1 already deleted. [ 577.271265] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-149ab387-d0f9-469a-929d-5210ce14f2f1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.754369] env[66519]: INFO networking_nsxv3.common.synchronization [None req-b9c41461-99d0-4964-bcfe-5580f7f7e0f6 None None] Enqueued Resource ID: ad0b4c31-8b4a-4e10-8b8b-68221df79b36 with Priority: HIGHEST for action port [ 578.755410] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad0b4c31-8b4a-4e10-8b8b-68221df79b36 with Priority: HIGHEST for action port [ 578.756056] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad0b4c31-8b4a-4e10-8b8b-68221df79b36 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.756426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad0b4c31-8b4a-4e10-8b8b-68221df79b36" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.756511] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad0b4c31-8b4a-4e10-8b8b-68221df79b36" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.756968] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad0b4c31-8b4a-4e10-8b8b-68221df79b36" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.757075] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad0b4c31-8b4a-4e10-8b8b-68221df79b36',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.904839] env[66519]: INFO networking_nsxv3.common.synchronization [None req-39bb5907-c289-4668-843a-768d5901358f None None] Enqueued Resource ID: e96dddd0-2373-4a8b-b707-1f51084e62ee with Priority: HIGHEST for action port [ 578.904839] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e96dddd0-2373-4a8b-b707-1f51084e62ee with Priority: HIGHEST for action port [ 578.904839] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-e96dddd0-2373-4a8b-b707-1f51084e62ee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.905055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e96dddd0-2373-4a8b-b707-1f51084e62ee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.905055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e96dddd0-2373-4a8b-b707-1f51084e62ee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.905381] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e96dddd0-2373-4a8b-b707-1f51084e62ee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.905480] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e96dddd0-2373-4a8b-b707-1f51084e62ee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.261171] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad0b4c31-8b4a-4e10-8b8b-68221df79b36 [ 579.261171] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.261452] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.261452] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.261617] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.261671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.261717] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad0b4c31-8b4a-4e10-8b8b-68221df79b36 already deleted. [ 579.261802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad0b4c31-8b4a-4e10-8b8b-68221df79b36" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.408023] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e96dddd0-2373-4a8b-b707-1f51084e62ee [ 579.408023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.408023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.408023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.408353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.408353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.408516] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e96dddd0-2373-4a8b-b707-1f51084e62ee already deleted. [ 579.408581] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e96dddd0-2373-4a8b-b707-1f51084e62ee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.626881] env[66519]: INFO networking_nsxv3.common.synchronization [None req-75360cc4-cb58-482d-9f4f-1ba822d9837a None None] Enqueued Resource ID: bf6b2153-9ef5-4756-b771-a34b611bcaea with Priority: HIGHEST for action port [ 579.627616] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf6b2153-9ef5-4756-b771-a34b611bcaea with Priority: HIGHEST for action port [ 579.627925] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf6b2153-9ef5-4756-b771-a34b611bcaea taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.628160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf6b2153-9ef5-4756-b771-a34b611bcaea" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.628160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf6b2153-9ef5-4756-b771-a34b611bcaea" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.628515] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf6b2153-9ef5-4756-b771-a34b611bcaea" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.628594] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf6b2153-9ef5-4756-b771-a34b611bcaea',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.133402] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf6b2153-9ef5-4756-b771-a34b611bcaea [ 580.133752] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.133823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.133862] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.134120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.134216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.134307] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf6b2153-9ef5-4756-b771-a34b611bcaea already deleted. [ 580.134800] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf6b2153-9ef5-4756-b771-a34b611bcaea" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.056549] env[66519]: INFO networking_nsxv3.common.synchronization [req-5cbb1ece-8229-4c4f-9f39-0d1a204d2e6e req-f02b70d1-47ee-4d05-ab9f-fd2fb5bccc8a tempest-DeleteServersAdminTestJSON-67108890 tempest-DeleteServersAdminTestJSON-67108890-project-member] Enqueued Resource ID: 6960f374-b898-4940-b626-d2d9b6819605 with Priority: HIGHEST for action security_group_members [ 581.059105] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6960f374-b898-4940-b626-d2d9b6819605 with Priority: HIGHEST for action security_group_members [ 581.059105] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6960f374-b898-4940-b626-d2d9b6819605 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.059105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.059105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.059105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.059105] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.059105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.059105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.059105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.059105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.059105] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6960f374-b898-4940-b626-d2d9b6819605',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.279315] env[66519]: INFO networking_nsxv3.common.synchronization [None req-edb0672b-d373-479f-b31f-64ad7568d1d8 None None] Enqueued Resource ID: d9cf471d-81e2-4668-bd06-d51ce81d55cf with Priority: HIGHEST for action port [ 581.279603] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9cf471d-81e2-4668-bd06-d51ce81d55cf with Priority: HIGHEST for action port [ 581.280170] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9cf471d-81e2-4668-bd06-d51ce81d55cf taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.280267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9cf471d-81e2-4668-bd06-d51ce81d55cf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.280300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9cf471d-81e2-4668-bd06-d51ce81d55cf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.280585] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9cf471d-81e2-4668-bd06-d51ce81d55cf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.280751] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9cf471d-81e2-4668-bd06-d51ce81d55cf',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.562297] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.562297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.562297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.562297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.562297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.562297] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.562573] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.562573] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.562631] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.562807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.562807] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6960f374-b898-4940-b626-d2d9b6819605 already deleted. [ 581.562886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.783017] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9cf471d-81e2-4668-bd06-d51ce81d55cf [ 581.783268] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.783401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.783470] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.783692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.783782] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.783877] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9cf471d-81e2-4668-bd06-d51ce81d55cf already deleted. [ 581.783973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9cf471d-81e2-4668-bd06-d51ce81d55cf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.845814] env[66519]: INFO networking_nsxv3.common.synchronization [None req-73934fc5-d834-4aae-a7ff-ed1dd2e2538f None None] Enqueued Resource ID: 0ad6da2f-1b99-4b45-ae5a-7f23cd1a46f7 with Priority: HIGHEST for action port [ 581.846301] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ad6da2f-1b99-4b45-ae5a-7f23cd1a46f7 with Priority: HIGHEST for action port [ 581.846623] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ad6da2f-1b99-4b45-ae5a-7f23cd1a46f7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.846744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ad6da2f-1b99-4b45-ae5a-7f23cd1a46f7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.846818] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ad6da2f-1b99-4b45-ae5a-7f23cd1a46f7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.847581] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ad6da2f-1b99-4b45-ae5a-7f23cd1a46f7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.847678] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ad6da2f-1b99-4b45-ae5a-7f23cd1a46f7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.298103] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.298441] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.298987] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.298987] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.298987] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.299861] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.300482] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.300482] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.300572] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.300826] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 582.300945] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 582.301060] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 582.301173] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 582.301314] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 582.301423] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 582.301556] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 582.322350] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 582.322350] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 582.322477] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 582.322652] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.322967] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-3e6afa57-a009-45c0-b6c5-05de626911ca taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.323152] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-3e6afa57-a009-45c0-b6c5-05de626911ca" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.323266] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-3e6afa57-a009-45c0-b6c5-05de626911ca" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.323578] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-3e6afa57-a009-45c0-b6c5-05de626911ca" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.323737] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e6afa57-a009-45c0-b6c5-05de626911ca',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.349657] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ad6da2f-1b99-4b45-ae5a-7f23cd1a46f7 [ 582.349880] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.350033] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.350128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.350316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.350421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.350597] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ad6da2f-1b99-4b45-ae5a-7f23cd1a46f7 already deleted. [ 582.350597] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ad6da2f-1b99-4b45-ae5a-7f23cd1a46f7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.826071] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.826298] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.826422] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.826731] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.826877] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.827034] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 3e6afa57-a009-45c0-b6c5-05de626911ca not found, creating... [ 582.827291] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.827448] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.827594] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.827813] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.827945] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.828319] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.828638] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.828638] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.828818] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.828903] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.829063] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 3e6afa57-a009-45c0-b6c5-05de626911ca is going to be created. [ 582.852552] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.852820] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.852820] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.853068] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.853295] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.853513] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-3e6afa57-a009-45c0-b6c5-05de626911ca" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.624207] env[66519]: INFO networking_nsxv3.common.synchronization [None req-53c6d9c7-7fb4-43e1-98c4-3a094f79c0b7 None None] Enqueued Resource ID: 40e101b1-3432-498b-ab9a-b6ca88e380bd with Priority: HIGHEST for action port [ 583.624207] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40e101b1-3432-498b-ab9a-b6ca88e380bd with Priority: HIGHEST for action port [ 583.624207] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-40e101b1-3432-498b-ab9a-b6ca88e380bd taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.624207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40e101b1-3432-498b-ab9a-b6ca88e380bd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.624207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40e101b1-3432-498b-ab9a-b6ca88e380bd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.624207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40e101b1-3432-498b-ab9a-b6ca88e380bd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.624207] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40e101b1-3432-498b-ab9a-b6ca88e380bd',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.633065] env[66519]: INFO networking_nsxv3.common.synchronization [req-5cbb1ece-8229-4c4f-9f39-0d1a204d2e6e req-b462f015-d1a4-4a97-a978-a73c48490226 service nova] Enqueued Resource ID: 6960f374-b898-4940-b626-d2d9b6819605 with Priority: HIGHEST for action security_group_rules [ 583.633240] env[66519]: INFO networking_nsxv3.common.synchronization [req-5cbb1ece-8229-4c4f-9f39-0d1a204d2e6e req-b462f015-d1a4-4a97-a978-a73c48490226 service nova] Enqueued Resource ID: 6960f374-b898-4940-b626-d2d9b6819605 with Priority: HIGHEST for action security_group_members [ 583.633533] env[66519]: INFO networking_nsxv3.common.synchronization [req-5cbb1ece-8229-4c4f-9f39-0d1a204d2e6e req-b462f015-d1a4-4a97-a978-a73c48490226 service nova] Enqueued Resource ID: 3e6afa57-a009-45c0-b6c5-05de626911ca with Priority: HIGHEST for action port [ 583.634329] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6960f374-b898-4940-b626-d2d9b6819605 with Priority: HIGHEST for action security_group_rules [ 583.634329] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6960f374-b898-4940-b626-d2d9b6819605 with Priority: HIGHEST for action security_group_members [ 583.634329] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e6afa57-a009-45c0-b6c5-05de626911ca with Priority: HIGHEST for action port [ 583.634493] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6960f374-b898-4940-b626-d2d9b6819605 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.634590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.634655] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.634897] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.634981] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6960f374-b898-4940-b626-d2d9b6819605',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.635781] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6960f374-b898-4940-b626-d2d9b6819605 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.635899] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.635966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.636162] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.636338] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.636452] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.636506] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.636666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.636770] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.636862] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6960f374-b898-4940-b626-d2d9b6819605',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.637894] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e6afa57-a009-45c0-b6c5-05de626911ca taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.638020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e6afa57-a009-45c0-b6c5-05de626911ca" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.638388] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e6afa57-a009-45c0-b6c5-05de626911ca" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.638543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e6afa57-a009-45c0-b6c5-05de626911ca" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.638543] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e6afa57-a009-45c0-b6c5-05de626911ca',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.128137] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40e101b1-3432-498b-ab9a-b6ca88e380bd [ 584.128441] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.128639] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.128730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.128971] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.129106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.129210] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40e101b1-3432-498b-ab9a-b6ca88e380bd already deleted. [ 584.129297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40e101b1-3432-498b-ab9a-b6ca88e380bd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.141952] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6960f374-b898-4940-b626-d2d9b6819605 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.142110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.150530] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e6afa57-a009-45c0-b6c5-05de626911ca with status ACTIVE [ 584.151016] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.151226] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.151339] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.152367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.152367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.152367] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.152367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.152367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.152367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.152367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.152367] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.152728] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.152728] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.152781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.152827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.152920] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e6afa57-a009-45c0-b6c5-05de626911ca is going to be updated. [ 584.155105] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6960f374-b898-4940-b626-d2d9b6819605',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.176386] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.176557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.176634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.176878] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.177105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.177511] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e6afa57-a009-45c0-b6c5-05de626911ca" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.658437] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6960f374-b898-4940-b626-d2d9b6819605',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.161052] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.161239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.161312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.161513] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.161601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.161700] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6960f374-b898-4940-b626-d2d9b6819605 is going to be created. [ 585.193418] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.193644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.193644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.193871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.193933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.204587] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6960f374-b898-4940-b626-d2d9b6819605 in Status: UNINITIALIZED for 2s [ 585.723923] env[66519]: INFO networking_nsxv3.common.synchronization [None req-c1e91918-01bd-4f6a-93cc-3255d4dd51bc None None] Enqueued Resource ID: b094b1bc-637c-4654-9b8b-99da0926d0b1 with Priority: HIGHEST for action port [ 585.724266] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b094b1bc-637c-4654-9b8b-99da0926d0b1 with Priority: HIGHEST for action port [ 585.724793] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-b094b1bc-637c-4654-9b8b-99da0926d0b1 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.724906] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b094b1bc-637c-4654-9b8b-99da0926d0b1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.724971] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b094b1bc-637c-4654-9b8b-99da0926d0b1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.725266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b094b1bc-637c-4654-9b8b-99da0926d0b1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.725344] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b094b1bc-637c-4654-9b8b-99da0926d0b1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.038075] env[66519]: INFO networking_nsxv3.common.synchronization [req-36655d53-5b5f-41f1-9c44-dea79e878e34 req-9e1f5bbf-9618-4f3f-8203-806d440ce8e3 tempest-ListServersNegativeTestJSON-1730331396 tempest-ListServersNegativeTestJSON-1730331396-project-member] Enqueued Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_members [ 586.038273] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_members [ 586.038680] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.038853] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.038925] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.039198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.039352] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.039446] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.039505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.039653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.039735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.039829] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.228416] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b094b1bc-637c-4654-9b8b-99da0926d0b1 [ 586.228649] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.228777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.228844] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.229074] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.229162] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.229253] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b094b1bc-637c-4654-9b8b-99da0926d0b1 already deleted. [ 586.229332] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b094b1bc-637c-4654-9b8b-99da0926d0b1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.542443] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.542443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.542601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.542703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.542803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.542995] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.543614] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.543757] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.543813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.543892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.543977] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5530bb2-b2db-4078-af78-1410edb05dd7 already deleted. [ 586.544093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.600808] env[66519]: INFO networking_nsxv3.common.synchronization [None req-f1d6a8c4-29b6-46a8-bb62-c34d5ff68934 None None] Enqueued Resource ID: 6df1b594-634d-42ad-a0b2-a6049788ddf5 with Priority: HIGHEST for action port [ 586.600808] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6df1b594-634d-42ad-a0b2-a6049788ddf5 with Priority: HIGHEST for action port [ 586.600936] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-6df1b594-634d-42ad-a0b2-a6049788ddf5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.601079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6df1b594-634d-42ad-a0b2-a6049788ddf5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.601153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6df1b594-634d-42ad-a0b2-a6049788ddf5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.601403] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6df1b594-634d-42ad-a0b2-a6049788ddf5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.601484] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6df1b594-634d-42ad-a0b2-a6049788ddf5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.622470] env[66519]: INFO networking_nsxv3.common.synchronization [None req-68a87f92-b93b-49da-999f-986937626b29 None None] Enqueued Resource ID: 7d68a955-88d4-43aa-bd4a-9306bc683be2 with Priority: HIGHEST for action port [ 586.622727] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d68a955-88d4-43aa-bd4a-9306bc683be2 with Priority: HIGHEST for action port [ 586.623473] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d68a955-88d4-43aa-bd4a-9306bc683be2 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.623592] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d68a955-88d4-43aa-bd4a-9306bc683be2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.623636] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d68a955-88d4-43aa-bd4a-9306bc683be2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.624416] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d68a955-88d4-43aa-bd4a-9306bc683be2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.624416] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d68a955-88d4-43aa-bd4a-9306bc683be2',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.104096] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6df1b594-634d-42ad-a0b2-a6049788ddf5 [ 587.104096] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.104096] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.104096] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.104532] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.104532] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.107944] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6df1b594-634d-42ad-a0b2-a6049788ddf5 already deleted. [ 587.108073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6df1b594-634d-42ad-a0b2-a6049788ddf5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.126191] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d68a955-88d4-43aa-bd4a-9306bc683be2 [ 587.126191] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.126191] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.126371] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.126515] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.126604] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.126697] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d68a955-88d4-43aa-bd4a-9306bc683be2 already deleted. [ 587.126776] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d68a955-88d4-43aa-bd4a-9306bc683be2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.217052] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6960f374-b898-4940-b626-d2d9b6819605 in Status: SUCCESS [ 587.219570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.219570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.219570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.219570] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.219570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.219570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.219570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.219570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.219570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.219570] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6960f374-b898-4940-b626-d2d9b6819605',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.639717] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-203 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.639904] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-203" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.640034] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-203" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.640366] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-203" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.640627] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.640778] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.640887] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.641206] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.641334] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.641532] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.641639] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 587.642461] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 587.642461] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 587.642461] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.642461] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 587.642461] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 587.660722] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 587.660953] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 587.661116] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 587.661288] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-203" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.661593] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-0482598d-8714-41d3-9944-5c64d14e7925 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.661746] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-0482598d-8714-41d3-9944-5c64d14e7925" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.661851] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-0482598d-8714-41d3-9944-5c64d14e7925" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.662252] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-0482598d-8714-41d3-9944-5c64d14e7925" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.662382] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0482598d-8714-41d3-9944-5c64d14e7925',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.720824] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6960f374-b898-4940-b626-d2d9b6819605 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.721043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.721043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.721360] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.721449] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.721563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.721627] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.721787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.722011] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.722011] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.722131] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6960f374-b898-4940-b626-d2d9b6819605 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.722223] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.722283] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.722424] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.722558] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.722649] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.722707] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.722843] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.722915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.722991] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.723089] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6960f374-b898-4940-b626-d2d9b6819605',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.165046] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.165460] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.165599] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.165957] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.166047] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.166178] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 0482598d-8714-41d3-9944-5c64d14e7925 not found, creating... [ 588.166821] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.166919] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.167031] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.167255] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.167388] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.167652] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.167805] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.167919] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.168132] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.168263] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.168401] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 0482598d-8714-41d3-9944-5c64d14e7925 is going to be created. [ 588.190507] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.192331] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.192331] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.192331] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.192977] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.192977] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-0482598d-8714-41d3-9944-5c64d14e7925" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.225477] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6960f374-b898-4940-b626-d2d9b6819605: rpc.has_security_group_logging(os_id): False [ 588.256210] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.256210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.256210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.256210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.256210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.256210] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.256210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.256210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.256210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.257915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.257915] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.257915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.257915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.257915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.257915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.257915] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.257915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.257915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.257915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.257915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.257915] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6960f374-b898-4940-b626-d2d9b6819605 is going to be created. [ 588.348536] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.348536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.348536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.348536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.348536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.365281] env[66519]: INFO networking_nsxv3.common.synchronization [None req-fc2a3de3-99ed-4dd9-8129-98913b7eee94 None None] Enqueued Resource ID: bd635a23-d524-4a93-97ad-7e5710a12d33 with Priority: HIGHEST for action port [ 588.367190] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd635a23-d524-4a93-97ad-7e5710a12d33 with Priority: HIGHEST for action port [ 588.367190] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6960f374-b898-4940-b626-d2d9b6819605 in Status: IN_PROGRESS for 2s [ 588.367190] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd635a23-d524-4a93-97ad-7e5710a12d33 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.367431] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd635a23-d524-4a93-97ad-7e5710a12d33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.367431] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd635a23-d524-4a93-97ad-7e5710a12d33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.367895] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd635a23-d524-4a93-97ad-7e5710a12d33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.367895] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd635a23-d524-4a93-97ad-7e5710a12d33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.596644] env[66519]: INFO networking_nsxv3.common.synchronization [None req-1d0a97a9-ceae-4516-b6f6-adedd7896002 None None] Enqueued Resource ID: 6a6b9ced-83a0-455f-9fd0-45080c1a251d with Priority: HIGHEST for action port [ 588.597263] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a6b9ced-83a0-455f-9fd0-45080c1a251d with Priority: HIGHEST for action port [ 588.597522] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a6b9ced-83a0-455f-9fd0-45080c1a251d taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.598051] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a6b9ced-83a0-455f-9fd0-45080c1a251d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.598051] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a6b9ced-83a0-455f-9fd0-45080c1a251d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.598890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a6b9ced-83a0-455f-9fd0-45080c1a251d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.598890] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a6b9ced-83a0-455f-9fd0-45080c1a251d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.870238] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd635a23-d524-4a93-97ad-7e5710a12d33 [ 588.871142] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.871337] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.871405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.871599] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.871691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.871854] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd635a23-d524-4a93-97ad-7e5710a12d33 already deleted. [ 588.871921] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd635a23-d524-4a93-97ad-7e5710a12d33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.995928] env[66519]: INFO networking_nsxv3.common.synchronization [req-36655d53-5b5f-41f1-9c44-dea79e878e34 req-8bad3e18-61a1-471e-877b-211ee4110ec2 service nova] Enqueued Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_rules [ 588.996736] env[66519]: INFO networking_nsxv3.common.synchronization [req-36655d53-5b5f-41f1-9c44-dea79e878e34 req-8bad3e18-61a1-471e-877b-211ee4110ec2 service nova] Enqueued Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_members [ 588.996736] env[66519]: INFO networking_nsxv3.common.synchronization [req-36655d53-5b5f-41f1-9c44-dea79e878e34 req-8bad3e18-61a1-471e-877b-211ee4110ec2 service nova] Enqueued Resource ID: 0482598d-8714-41d3-9944-5c64d14e7925 with Priority: HIGHEST for action port [ 588.996893] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_rules [ 588.997098] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_members [ 588.999039] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0482598d-8714-41d3-9944-5c64d14e7925 with Priority: HIGHEST for action port [ 588.999683] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.999823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.999879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.000379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.000379] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.001823] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.001823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.002216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.002216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.004550] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.004550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.004550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.004550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.004550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.004825] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.006015] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-0482598d-8714-41d3-9944-5c64d14e7925 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.006128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0482598d-8714-41d3-9944-5c64d14e7925" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.006351] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0482598d-8714-41d3-9944-5c64d14e7925" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.006420] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0482598d-8714-41d3-9944-5c64d14e7925" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.006705] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0482598d-8714-41d3-9944-5c64d14e7925',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.100621] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a6b9ced-83a0-455f-9fd0-45080c1a251d [ 589.100821] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.100954] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.101028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.101270] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.101406] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.101448] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a6b9ced-83a0-455f-9fd0-45080c1a251d already deleted. [ 589.101534] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a6b9ced-83a0-455f-9fd0-45080c1a251d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.160463] env[66519]: INFO networking_nsxv3.common.synchronization [None req-8e1f8136-94ee-4167-af57-7a0a96d3a55b None None] Enqueued Resource ID: 56948ea5-5f08-4bf5-b1e7-9a306df544dd with Priority: HIGHEST for action port [ 589.160724] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56948ea5-5f08-4bf5-b1e7-9a306df544dd with Priority: HIGHEST for action port [ 589.161663] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-56948ea5-5f08-4bf5-b1e7-9a306df544dd taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.161663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56948ea5-5f08-4bf5-b1e7-9a306df544dd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.161663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56948ea5-5f08-4bf5-b1e7-9a306df544dd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.161926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56948ea5-5f08-4bf5-b1e7-9a306df544dd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.161926] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56948ea5-5f08-4bf5-b1e7-9a306df544dd',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.244760] env[66519]: INFO networking_nsxv3.common.synchronization [req-36655d53-5b5f-41f1-9c44-dea79e878e34 req-ebbc3e89-aff6-4e3c-9691-76658e54ec79 tempest-ListServersNegativeTestJSON-1730331396 tempest-ListServersNegativeTestJSON-1730331396-project-member] Enqueued Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_members [ 589.245392] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_members [ 589.245724] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.245830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.508916] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.508916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.509063] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.510414] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0482598d-8714-41d3-9944-5c64d14e7925 with status ACTIVE [ 589.510414] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.510414] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.510414] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.510570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.510570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.510734] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.510823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.510880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.511041] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.511112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.511288] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.511395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.511453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.511591] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.511660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.511738] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0482598d-8714-41d3-9944-5c64d14e7925 is going to be updated. [ 589.533833] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.533966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.534046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.534327] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.534463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.534652] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0482598d-8714-41d3-9944-5c64d14e7925" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.665040] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56948ea5-5f08-4bf5-b1e7-9a306df544dd [ 589.665235] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.665416] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.665491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.665719] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.665809] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.665911] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56948ea5-5f08-4bf5-b1e7-9a306df544dd already deleted. [ 589.666351] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56948ea5-5f08-4bf5-b1e7-9a306df544dd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.728213] env[66519]: INFO networking_nsxv3.common.synchronization [None req-a9002cf6-9522-444b-b6a7-190b8942eebd None None] Enqueued Resource ID: 5a93a737-e8c1-4d66-abcb-9a19ba9a485b with Priority: HIGHEST for action port [ 589.729151] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a93a737-e8c1-4d66-abcb-9a19ba9a485b with Priority: HIGHEST for action port [ 589.730334] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a93a737-e8c1-4d66-abcb-9a19ba9a485b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.730501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a93a737-e8c1-4d66-abcb-9a19ba9a485b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.730644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a93a737-e8c1-4d66-abcb-9a19ba9a485b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.731241] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a93a737-e8c1-4d66-abcb-9a19ba9a485b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.732208] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a93a737-e8c1-4d66-abcb-9a19ba9a485b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.015043] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.234478] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a93a737-e8c1-4d66-abcb-9a19ba9a485b [ 590.236052] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.236052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.236052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.236052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.236052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.236052] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a93a737-e8c1-4d66-abcb-9a19ba9a485b already deleted. [ 590.236052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a93a737-e8c1-4d66-abcb-9a19ba9a485b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.383785] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6960f374-b898-4940-b626-d2d9b6819605 in Status: SUCCESS [ 590.383785] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.417388] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-203 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.419451] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-203" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.419451] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-203" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.419451] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-203" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.419451] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.419451] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.419451] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.419451] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.419451] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.419451] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 590.419451] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 590.419451] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 590.419451] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 590.419971] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 590.419971] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 590.419971] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 590.439514] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 590.439682] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 590.439813] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 590.439981] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-203" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.440304] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-3ff9f201-58ac-4253-a9b7-d2f973aa775f taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.440470] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-3ff9f201-58ac-4253-a9b7-d2f973aa775f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.440578] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-3ff9f201-58ac-4253-a9b7-d2f973aa775f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.440891] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-3ff9f201-58ac-4253-a9b7-d2f973aa775f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.441027] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ff9f201-58ac-4253-a9b7-d2f973aa775f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.480744] env[66519]: INFO networking_nsxv3.common.synchronization [req-36655d53-5b5f-41f1-9c44-dea79e878e34 req-e89e9468-5568-456c-8840-1309e3982d82 tempest-ListServersNegativeTestJSON-1730331396 tempest-ListServersNegativeTestJSON-1730331396-project-member] Enqueued Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_members [ 590.483063] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_members [ 590.483063] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.483063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.516405] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.516673] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.516673] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.516846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.516933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.517044] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5530bb2-b2db-4078-af78-1410edb05dd7 is going to be created. [ 590.543772] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.543951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.545337] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.545337] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.545337] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.555510] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: UNINITIALIZED for 2s [ 590.944555] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.944742] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.944862] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.945142] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.945291] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.945443] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 3ff9f201-58ac-4253-a9b7-d2f973aa775f not found, creating... [ 590.945700] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.945849] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.945970] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.946197] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.946325] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.946595] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.947214] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.947214] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.947214] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.947214] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.947355] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 3ff9f201-58ac-4253-a9b7-d2f973aa775f is going to be created. [ 590.969067] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.969435] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.969435] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.969647] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.969864] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.970200] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-3ff9f201-58ac-4253-a9b7-d2f973aa775f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.131721] env[66519]: INFO networking_nsxv3.common.synchronization [None req-1f2eb0d7-ebce-4dd3-88cf-3ef3242ad34c None None] Enqueued Resource ID: 3cf96d23-7e49-4f48-ab04-2d0d9f3fd3e2 with Priority: HIGHEST for action port [ 591.132289] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cf96d23-7e49-4f48-ab04-2d0d9f3fd3e2 with Priority: HIGHEST for action port [ 591.132588] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cf96d23-7e49-4f48-ab04-2d0d9f3fd3e2 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.132718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cf96d23-7e49-4f48-ab04-2d0d9f3fd3e2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.132786] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cf96d23-7e49-4f48-ab04-2d0d9f3fd3e2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.133154] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cf96d23-7e49-4f48-ab04-2d0d9f3fd3e2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.133154] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cf96d23-7e49-4f48-ab04-2d0d9f3fd3e2',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.193955] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-203 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.194171] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-203" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.194372] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-203" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.194644] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-203" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.194901] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.195894] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.195982] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.196192] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.196548] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.196641] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.196735] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 591.197063] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 591.197063] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 591.197158] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.197203] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 591.197294] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 591.220926] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 591.221722] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 591.221722] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 591.221722] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-203" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.221722] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-a6fad4c4-d06c-49c5-9f79-2b0d906afa4b taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.222035] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-a6fad4c4-d06c-49c5-9f79-2b0d906afa4b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.222035] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-a6fad4c4-d06c-49c5-9f79-2b0d906afa4b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.222770] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-a6fad4c4-d06c-49c5-9f79-2b0d906afa4b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.222770] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6fad4c4-d06c-49c5-9f79-2b0d906afa4b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.636288] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cf96d23-7e49-4f48-ab04-2d0d9f3fd3e2 [ 591.636531] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.636636] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.636636] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.636839] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.636929] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.637033] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cf96d23-7e49-4f48-ab04-2d0d9f3fd3e2 already deleted. [ 591.637119] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cf96d23-7e49-4f48-ab04-2d0d9f3fd3e2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.701669] env[66519]: INFO networking_nsxv3.common.synchronization [req-36655d53-5b5f-41f1-9c44-dea79e878e34 req-9a902f1e-1a8a-4b32-a16a-b734d73f7ed5 service nova] Enqueued Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_rules [ 591.701799] env[66519]: INFO networking_nsxv3.common.synchronization [req-36655d53-5b5f-41f1-9c44-dea79e878e34 req-9a902f1e-1a8a-4b32-a16a-b734d73f7ed5 service nova] Enqueued Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_members [ 591.703252] env[66519]: INFO networking_nsxv3.common.synchronization [req-36655d53-5b5f-41f1-9c44-dea79e878e34 req-9a902f1e-1a8a-4b32-a16a-b734d73f7ed5 service nova] Enqueued Resource ID: 3ff9f201-58ac-4253-a9b7-d2f973aa775f with Priority: HIGHEST for action port [ 591.703252] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_rules [ 591.703252] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_members [ 591.703252] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ff9f201-58ac-4253-a9b7-d2f973aa775f with Priority: HIGHEST for action port [ 591.703252] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.703660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.703660] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.703660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.703865] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ff9f201-58ac-4253-a9b7-d2f973aa775f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.703865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ff9f201-58ac-4253-a9b7-d2f973aa775f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.703865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ff9f201-58ac-4253-a9b7-d2f973aa775f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.704443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ff9f201-58ac-4253-a9b7-d2f973aa775f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.704443] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ff9f201-58ac-4253-a9b7-d2f973aa775f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.724373] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.724588] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.724764] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.724973] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.725126] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.725286] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port a6fad4c4-d06c-49c5-9f79-2b0d906afa4b not found, creating... [ 591.725537] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.725689] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.725818] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.726080] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.726180] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.726463] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.726653] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.726760] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.726958] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.727228] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.727228] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: a6fad4c4-d06c-49c5-9f79-2b0d906afa4b is going to be created. [ 591.747996] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.747996] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.747996] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.747996] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.747996] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.748394] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-a6fad4c4-d06c-49c5-9f79-2b0d906afa4b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.940128] env[66519]: INFO networking_nsxv3.common.synchronization [None req-c435a7ea-58c2-4453-9565-220c5b2660c8 None None] Enqueued Resource ID: 7655ac75-f593-4589-8c0a-9fce677ab32e with Priority: HIGHEST for action port [ 591.940658] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7655ac75-f593-4589-8c0a-9fce677ab32e with Priority: HIGHEST for action port [ 591.941131] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-7655ac75-f593-4589-8c0a-9fce677ab32e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.941131] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7655ac75-f593-4589-8c0a-9fce677ab32e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.941131] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7655ac75-f593-4589-8c0a-9fce677ab32e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.941382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7655ac75-f593-4589-8c0a-9fce677ab32e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.941460] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7655ac75-f593-4589-8c0a-9fce677ab32e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.205989] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ff9f201-58ac-4253-a9b7-d2f973aa775f with status ACTIVE [ 592.206244] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.206379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.206440] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.206671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.206770] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.206963] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.207078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.207136] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.207484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.207484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.207584] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.207639] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.207719] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.207816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.207865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.207950] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ff9f201-58ac-4253-a9b7-d2f973aa775f is going to be updated. [ 592.229202] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.229343] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.229437] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.229611] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.229774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.229896] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ff9f201-58ac-4253-a9b7-d2f973aa775f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.447066] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7655ac75-f593-4589-8c0a-9fce677ab32e [ 592.447066] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.447066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.447066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.447066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.447066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.447066] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7655ac75-f593-4589-8c0a-9fce677ab32e already deleted. [ 592.447066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7655ac75-f593-4589-8c0a-9fce677ab32e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.565759] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: SUCCESS [ 592.566179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.566179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.566366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.566552] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.566654] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.566717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.566874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.566951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.567048] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.578859] env[66519]: INFO networking_nsxv3.common.synchronization [req-36655d53-5b5f-41f1-9c44-dea79e878e34 req-75bd8e92-31ea-45fd-bef3-9a91d53f8dbf service nova] Enqueued Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_rules [ 592.578859] env[66519]: INFO networking_nsxv3.common.synchronization [req-36655d53-5b5f-41f1-9c44-dea79e878e34 req-75bd8e92-31ea-45fd-bef3-9a91d53f8dbf service nova] Enqueued Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_members [ 592.578859] env[66519]: INFO networking_nsxv3.common.synchronization [req-36655d53-5b5f-41f1-9c44-dea79e878e34 req-75bd8e92-31ea-45fd-bef3-9a91d53f8dbf service nova] Enqueued Resource ID: a6fad4c4-d06c-49c5-9f79-2b0d906afa4b with Priority: HIGHEST for action port [ 592.579980] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_rules [ 592.579980] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_members [ 592.580137] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6fad4c4-d06c-49c5-9f79-2b0d906afa4b with Priority: HIGHEST for action port [ 592.580730] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.580836] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.581368] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.581494] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.581694] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6fad4c4-d06c-49c5-9f79-2b0d906afa4b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.581793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6fad4c4-d06c-49c5-9f79-2b0d906afa4b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.581853] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6fad4c4-d06c-49c5-9f79-2b0d906afa4b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.582112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6fad4c4-d06c-49c5-9f79-2b0d906afa4b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.582202] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6fad4c4-d06c-49c5-9f79-2b0d906afa4b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.995244] env[66519]: INFO networking_nsxv3.common.synchronization [req-7ff7c247-2f67-4970-89ac-10feff06cb4f req-6c2cbf95-53b9-4741-b84f-a7a9dac18483 tempest-ServerDiagnosticsNegativeTest-1592588629 tempest-ServerDiagnosticsNegativeTest-1592588629-project-member] Enqueued Resource ID: bb0d178a-aa94-4307-b6dd-b216489030fb with Priority: HIGHEST for action security_group_members [ 592.995514] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb0d178a-aa94-4307-b6dd-b216489030fb with Priority: HIGHEST for action security_group_members [ 592.996387] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb0d178a-aa94-4307-b6dd-b216489030fb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.996387] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.996387] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.996387] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.996387] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.996387] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.997203] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.997203] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.997203] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.997203] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb0d178a-aa94-4307-b6dd-b216489030fb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.071256] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.087753] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6fad4c4-d06c-49c5-9f79-2b0d906afa4b with status ACTIVE [ 593.087753] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.087753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.087753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.087753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.087753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.087753] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.087753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.087753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.087753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.087753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.087753] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.087753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.087753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.087753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.087753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.087753] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6fad4c4-d06c-49c5-9f79-2b0d906afa4b is going to be updated. [ 593.117958] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.118176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.118225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.118421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.118572] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.118727] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6fad4c4-d06c-49c5-9f79-2b0d906afa4b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.365753] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.365956] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.366099] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.366486] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.366797] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.366968] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.367131] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.367371] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.367489] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.367728] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 593.367861] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 593.367970] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 593.368085] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 593.368200] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 593.368301] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 593.368431] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 593.389212] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 593.389429] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 593.389493] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 593.389668] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.390086] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-cdb69774-9eba-4abc-8528-6b2bf6be846d taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.390399] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-cdb69774-9eba-4abc-8528-6b2bf6be846d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.390491] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-cdb69774-9eba-4abc-8528-6b2bf6be846d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.390972] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-cdb69774-9eba-4abc-8528-6b2bf6be846d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.391230] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdb69774-9eba-4abc-8528-6b2bf6be846d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.499088] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.499315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.499407] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.499750] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.499915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.500226] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.500397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.500504] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.500754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.500863] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.500979] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb0d178a-aa94-4307-b6dd-b216489030fb already deleted. [ 593.501119] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.574305] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.896233] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.896233] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.896233] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.896233] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.896233] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.896233] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port cdb69774-9eba-4abc-8528-6b2bf6be846d not found, creating... [ 593.896233] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.896233] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.896233] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.896233] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.897477] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.897477] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.897631] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.897716] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.900997] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.900997] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.900997] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: cdb69774-9eba-4abc-8528-6b2bf6be846d is going to be created. [ 593.924127] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.926040] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.926040] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.926040] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.926040] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.926040] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-cdb69774-9eba-4abc-8528-6b2bf6be846d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.076586] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.076928] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.076928] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.077981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.077981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.077981] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5530bb2-b2db-4078-af78-1410edb05dd7 is going to be updated. [ 594.123858] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.124997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.124997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.124997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.125195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.135916] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: IN_PROGRESS for 2s [ 594.703483] env[66519]: INFO networking_nsxv3.common.synchronization [req-7ff7c247-2f67-4970-89ac-10feff06cb4f req-5c4abc42-8e17-46f3-a20f-9aeb2b824aae service nova] Enqueued Resource ID: bb0d178a-aa94-4307-b6dd-b216489030fb with Priority: HIGHEST for action security_group_rules [ 594.703483] env[66519]: INFO networking_nsxv3.common.synchronization [req-7ff7c247-2f67-4970-89ac-10feff06cb4f req-5c4abc42-8e17-46f3-a20f-9aeb2b824aae service nova] Enqueued Resource ID: bb0d178a-aa94-4307-b6dd-b216489030fb with Priority: HIGHEST for action security_group_members [ 594.703483] env[66519]: INFO networking_nsxv3.common.synchronization [req-7ff7c247-2f67-4970-89ac-10feff06cb4f req-5c4abc42-8e17-46f3-a20f-9aeb2b824aae service nova] Enqueued Resource ID: cdb69774-9eba-4abc-8528-6b2bf6be846d with Priority: HIGHEST for action port [ 594.703837] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb0d178a-aa94-4307-b6dd-b216489030fb with Priority: HIGHEST for action security_group_rules [ 594.703974] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb0d178a-aa94-4307-b6dd-b216489030fb with Priority: HIGHEST for action security_group_members [ 594.704780] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdb69774-9eba-4abc-8528-6b2bf6be846d with Priority: HIGHEST for action port [ 594.705170] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb0d178a-aa94-4307-b6dd-b216489030fb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.705350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.705421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.705676] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.705757] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb0d178a-aa94-4307-b6dd-b216489030fb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.707022] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb0d178a-aa94-4307-b6dd-b216489030fb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.707022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.707022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.707216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.707309] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.707368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.707417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.707557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.707641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.707728] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb0d178a-aa94-4307-b6dd-b216489030fb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.708500] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdb69774-9eba-4abc-8528-6b2bf6be846d taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.708586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdb69774-9eba-4abc-8528-6b2bf6be846d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.708627] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdb69774-9eba-4abc-8528-6b2bf6be846d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.708773] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdb69774-9eba-4abc-8528-6b2bf6be846d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.708851] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdb69774-9eba-4abc-8528-6b2bf6be846d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.061501] env[66519]: INFO networking_nsxv3.common.synchronization [None req-a04288a8-4508-4066-8c85-c7cd9e46b065 tempest-VolumesAssistedSnapshotsTest-1753704316 tempest-VolumesAssistedSnapshotsTest-1753704316-project-member] Enqueued Resource ID: facac47b-64fc-4659-9f54-1cb6066b4b88 with Priority: HIGHEST for action security_group_rules [ 595.062305] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: facac47b-64fc-4659-9f54-1cb6066b4b88 with Priority: HIGHEST for action security_group_rules [ 595.062939] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-facac47b-64fc-4659-9f54-1cb6066b4b88 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.063224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.063330] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.063645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.063838] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('facac47b-64fc-4659-9f54-1cb6066b4b88',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.187387] env[66519]: INFO networking_nsxv3.common.synchronization [None req-33bf0d57-50f0-42d2-abd4-358d40983f98 tempest-VolumesAssistedSnapshotsTest-1753704316 tempest-VolumesAssistedSnapshotsTest-1753704316-project-member] Enqueued Resource ID: facac47b-64fc-4659-9f54-1cb6066b4b88 with Priority: HIGHEST for action security_group_rules [ 595.188041] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: facac47b-64fc-4659-9f54-1cb6066b4b88 with Priority: HIGHEST for action security_group_rules [ 595.188470] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-facac47b-64fc-4659-9f54-1cb6066b4b88 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.188600] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.210704] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb0d178a-aa94-4307-b6dd-b216489030fb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.212020] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb0d178a-aa94-4307-b6dd-b216489030fb taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.212181] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.214569] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cdb69774-9eba-4abc-8528-6b2bf6be846d with status ACTIVE [ 595.214569] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.214569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.214569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.214569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.214569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.214569] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.214569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.214569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.217760] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.217866] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.218133] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.218250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.218313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.218585] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.218585] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.218713] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cdb69774-9eba-4abc-8528-6b2bf6be846d is going to be updated. [ 595.279142] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.279243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.279243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.279462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.279601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.279762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdb69774-9eba-4abc-8528-6b2bf6be846d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.585858] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.586052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.586052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.586201] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.586296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.586393] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: facac47b-64fc-4659-9f54-1cb6066b4b88 already deleted. [ 595.586479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.586630] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.586789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.586868] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('facac47b-64fc-4659-9f54-1cb6066b4b88',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.722310] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb0d178a-aa94-4307-b6dd-b216489030fb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.111252] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.111252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.111252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.111252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.111252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.111252] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: facac47b-64fc-4659-9f54-1cb6066b4b88 already deleted. [ 596.111252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.148034] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: SUCCESS [ 596.148034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.148034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.148034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.148034] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.148034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.148034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.148034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.148034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.148034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.148034] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.148998] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.149275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.149518] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.149754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.149907] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.150146] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.150301] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.150454] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.226899] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.227251] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.227251] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.228040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.229458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.229458] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb0d178a-aa94-4307-b6dd-b216489030fb is going to be created. [ 596.252743] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.252904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.252976] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.253234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.253406] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.263461] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb0d178a-aa94-4307-b6dd-b216489030fb in Status: UNINITIALIZED for 2s [ 596.652321] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.652492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.652697] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.156759] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.658795] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.659158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.659158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.659743] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.659743] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.659743] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5530bb2-b2db-4078-af78-1410edb05dd7 is going to be updated. [ 597.687623] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.687780] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.687861] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.688115] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.688265] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.698839] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: IN_PROGRESS for 2s [ 598.292073] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb0d178a-aa94-4307-b6dd-b216489030fb in Status: SUCCESS [ 598.292073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.294923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.294923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.294923] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.294923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.294923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.294923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.294923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.294923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.294923] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb0d178a-aa94-4307-b6dd-b216489030fb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.799912] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb0d178a-aa94-4307-b6dd-b216489030fb taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.799912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.799912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.799912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.799912] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.799912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.799912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.799912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.799912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.799912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.799912] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb0d178a-aa94-4307-b6dd-b216489030fb taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.799912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.799912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.799912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.799912] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.799912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.800822] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.800822] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.800822] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.800822] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.800822] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb0d178a-aa94-4307-b6dd-b216489030fb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.304660] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb0d178a-aa94-4307-b6dd-b216489030fb: rpc.has_security_group_logging(os_id): False [ 599.325528] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.325769] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.325769] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.325969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.326089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.326479] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.326586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.326668] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.326835] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.327040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.327306] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.327393] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.327446] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.327736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.327888] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.328151] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.328283] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.328416] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.328487] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.328650] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.328779] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb0d178a-aa94-4307-b6dd-b216489030fb is going to be created. [ 599.397587] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.397790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.398416] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.398416] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.398640] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.417766] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb0d178a-aa94-4307-b6dd-b216489030fb in Status: IN_PROGRESS for 2s [ 599.710410] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: SUCCESS [ 599.710498] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.710677] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.710914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.711115] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.711238] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.711297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.711960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.711960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.711960] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.113797] env[66519]: INFO networking_nsxv3.common.synchronization [None req-9ebc9945-f68a-4e8b-9e76-056f901bfc7b None None] Enqueued Resource ID: 67b4e47b-fe9f-465e-8974-26a1e5f5b03c with Priority: HIGHEST for action port [ 600.114669] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67b4e47b-fe9f-465e-8974-26a1e5f5b03c with Priority: HIGHEST for action port [ 600.114959] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-67b4e47b-fe9f-465e-8974-26a1e5f5b03c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.115097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67b4e47b-fe9f-465e-8974-26a1e5f5b03c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.115194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67b4e47b-fe9f-465e-8974-26a1e5f5b03c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.115434] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67b4e47b-fe9f-465e-8974-26a1e5f5b03c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.115505] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67b4e47b-fe9f-465e-8974-26a1e5f5b03c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.215167] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.520146] env[66519]: INFO networking_nsxv3.common.synchronization [req-420df005-c160-40b3-8a4f-bbfb80f65f64 req-a15b6523-1c59-4b16-b858-18549d1d4c7c tempest-ServerExternalEventsTest-1641976964 tempest-ServerExternalEventsTest-1641976964-project-member] Enqueued Resource ID: 91966b7c-171f-4c65-8a17-9eb277064959 with Priority: HIGHEST for action security_group_members [ 600.520808] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91966b7c-171f-4c65-8a17-9eb277064959 with Priority: HIGHEST for action security_group_members [ 600.521192] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-91966b7c-171f-4c65-8a17-9eb277064959 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.521323] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.521413] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.521924] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.521924] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.522084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.522194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.522425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.522594] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.522762] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91966b7c-171f-4c65-8a17-9eb277064959',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.620638] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67b4e47b-fe9f-465e-8974-26a1e5f5b03c [ 600.620935] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.621118] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.621199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.621410] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.621530] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.621671] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67b4e47b-fe9f-465e-8974-26a1e5f5b03c already deleted. [ 600.621793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67b4e47b-fe9f-465e-8974-26a1e5f5b03c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.718118] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.029588] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.029772] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.029842] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.030098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.030178] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.030389] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.030526] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.030610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.031551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.031551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.031551] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91966b7c-171f-4c65-8a17-9eb277064959 already deleted. [ 601.031551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.220817] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.221243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.221243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.223235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.223235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.223235] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5530bb2-b2db-4078-af78-1410edb05dd7 is going to be updated. [ 601.265424] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.265690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.265690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.265918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.266185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.284558] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: IN_PROGRESS for 2s [ 601.345950] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.346150] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.346271] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.346581] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.346897] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.347304] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.347460] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.348548] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.348548] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.348548] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.348548] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 601.348548] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 601.348548] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 601.348548] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.348937] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 601.348937] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 601.374804] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 601.374804] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 601.374804] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 601.374804] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.374947] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-b8aa57f3-b776-42b5-8b89-2f1dc966cd02 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.375049] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-b8aa57f3-b776-42b5-8b89-2f1dc966cd02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.375167] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-b8aa57f3-b776-42b5-8b89-2f1dc966cd02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.375517] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-b8aa57f3-b776-42b5-8b89-2f1dc966cd02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.375681] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8aa57f3-b776-42b5-8b89-2f1dc966cd02',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.434561] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb0d178a-aa94-4307-b6dd-b216489030fb in Status: SUCCESS [ 601.434935] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.657515] env[66519]: INFO networking_nsxv3.common.synchronization [None req-8c47fd91-e0f4-4fe8-8da9-4ca0e5be3aad None None] Enqueued Resource ID: b9edba4d-7de8-4e44-94dd-ba2759820983 with Priority: HIGHEST for action port [ 601.658283] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9edba4d-7de8-4e44-94dd-ba2759820983 with Priority: HIGHEST for action port [ 601.658645] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9edba4d-7de8-4e44-94dd-ba2759820983 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.660635] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9edba4d-7de8-4e44-94dd-ba2759820983" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.660635] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9edba4d-7de8-4e44-94dd-ba2759820983" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.660635] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9edba4d-7de8-4e44-94dd-ba2759820983" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.660635] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9edba4d-7de8-4e44-94dd-ba2759820983',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.879364] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.879630] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.879771] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.880094] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.880533] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.880533] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port b8aa57f3-b776-42b5-8b89-2f1dc966cd02 not found, creating... [ 601.880741] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.880900] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.881247] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.881290] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.883932] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.883932] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.883932] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.883932] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.883932] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.883932] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.883932] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: b8aa57f3-b776-42b5-8b89-2f1dc966cd02 is going to be created. [ 601.908170] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.908472] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.908472] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.908745] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.909080] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.909264] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-b8aa57f3-b776-42b5-8b89-2f1dc966cd02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.162811] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9edba4d-7de8-4e44-94dd-ba2759820983 [ 602.164101] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.164101] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.164101] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.164431] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.164941] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.165130] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9edba4d-7de8-4e44-94dd-ba2759820983 already deleted. [ 602.165284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9edba4d-7de8-4e44-94dd-ba2759820983" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.780797] env[66519]: INFO networking_nsxv3.common.synchronization [req-420df005-c160-40b3-8a4f-bbfb80f65f64 req-bc5903ee-9310-494a-b354-ddfc228fe2b2 service nova] Enqueued Resource ID: 91966b7c-171f-4c65-8a17-9eb277064959 with Priority: HIGHEST for action security_group_rules [ 602.781160] env[66519]: INFO networking_nsxv3.common.synchronization [req-420df005-c160-40b3-8a4f-bbfb80f65f64 req-bc5903ee-9310-494a-b354-ddfc228fe2b2 service nova] Enqueued Resource ID: 91966b7c-171f-4c65-8a17-9eb277064959 with Priority: HIGHEST for action security_group_members [ 602.781160] env[66519]: INFO networking_nsxv3.common.synchronization [req-420df005-c160-40b3-8a4f-bbfb80f65f64 req-bc5903ee-9310-494a-b354-ddfc228fe2b2 service nova] Enqueued Resource ID: b8aa57f3-b776-42b5-8b89-2f1dc966cd02 with Priority: HIGHEST for action port [ 602.781780] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91966b7c-171f-4c65-8a17-9eb277064959 with Priority: HIGHEST for action security_group_rules [ 602.781842] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91966b7c-171f-4c65-8a17-9eb277064959 with Priority: HIGHEST for action security_group_members [ 602.782184] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8aa57f3-b776-42b5-8b89-2f1dc966cd02 with Priority: HIGHEST for action port [ 602.782504] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91966b7c-171f-4c65-8a17-9eb277064959 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.782504] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.782504] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.782701] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.783390] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91966b7c-171f-4c65-8a17-9eb277064959',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.784207] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-91966b7c-171f-4c65-8a17-9eb277064959 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.784207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.784361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.784552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.784673] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.784732] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.785718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.785718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.785718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.785718] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91966b7c-171f-4c65-8a17-9eb277064959',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.785948] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8aa57f3-b776-42b5-8b89-2f1dc966cd02 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.787035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8aa57f3-b776-42b5-8b89-2f1dc966cd02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.787035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8aa57f3-b776-42b5-8b89-2f1dc966cd02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.787035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8aa57f3-b776-42b5-8b89-2f1dc966cd02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.787035] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8aa57f3-b776-42b5-8b89-2f1dc966cd02',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.893033] env[66519]: INFO networking_nsxv3.common.synchronization [None req-2f1adda6-87ac-4289-a5c5-3064cacf3e27 None None] Enqueued Resource ID: 9aa8979f-a3a8-42ac-9ae3-5543e0e25dde with Priority: HIGHEST for action port [ 602.893758] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9aa8979f-a3a8-42ac-9ae3-5543e0e25dde with Priority: HIGHEST for action port [ 602.894157] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-9aa8979f-a3a8-42ac-9ae3-5543e0e25dde taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.894486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9aa8979f-a3a8-42ac-9ae3-5543e0e25dde" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.894486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9aa8979f-a3a8-42ac-9ae3-5543e0e25dde" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.894763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9aa8979f-a3a8-42ac-9ae3-5543e0e25dde" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.894865] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9aa8979f-a3a8-42ac-9ae3-5543e0e25dde',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.288244] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-91966b7c-171f-4c65-8a17-9eb277064959 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.288540] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.288739] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('91966b7c-171f-4c65-8a17-9eb277064959',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.289965] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8aa57f3-b776-42b5-8b89-2f1dc966cd02 with status ACTIVE [ 603.289965] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.290110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.290110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.290307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.290396] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.290573] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.290670] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.290788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.290927] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.290978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.291604] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.291720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.291811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.291990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.292109] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.292230] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8aa57f3-b776-42b5-8b89-2f1dc966cd02 is going to be updated. [ 603.295771] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: SUCCESS [ 603.296067] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.296232] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.296449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.296653] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.296831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.296920] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.297119] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.297184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.297284] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.352051] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.352246] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.352246] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.353053] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.353053] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.353384] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8aa57f3-b776-42b5-8b89-2f1dc966cd02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.397901] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9aa8979f-a3a8-42ac-9ae3-5543e0e25dde [ 603.398208] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.398372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.398476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.398713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.398806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.398928] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9aa8979f-a3a8-42ac-9ae3-5543e0e25dde already deleted. [ 603.399020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9aa8979f-a3a8-42ac-9ae3-5543e0e25dde" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.796042] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('91966b7c-171f-4c65-8a17-9eb277064959',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.800805] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.080431] env[66519]: INFO networking_nsxv3.common.synchronization [None req-c19816d1-b60a-4fff-8e04-15b22c318250 None None] Enqueued Resource ID: 47d9aeee-27b7-465a-8e0b-ac82c20d44c4 with Priority: HIGHEST for action port [ 604.082561] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47d9aeee-27b7-465a-8e0b-ac82c20d44c4 with Priority: HIGHEST for action port [ 604.082561] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-47d9aeee-27b7-465a-8e0b-ac82c20d44c4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.082561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47d9aeee-27b7-465a-8e0b-ac82c20d44c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.082561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47d9aeee-27b7-465a-8e0b-ac82c20d44c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.082561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47d9aeee-27b7-465a-8e0b-ac82c20d44c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.082561] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47d9aeee-27b7-465a-8e0b-ac82c20d44c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.257357] env[66519]: INFO networking_nsxv3.common.synchronization [None req-55a8fc4f-3735-4854-862f-2e1f1f324a54 tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 with Priority: HIGHEST for action security_group_rules [ 604.257635] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 with Priority: HIGHEST for action security_group_rules [ 604.257778] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8a24d0e-87af-4465-ae43-ca9c589fc6b0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.257944] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.258027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.258910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.259057] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8a24d0e-87af-4465-ae43-ca9c589fc6b0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.298717] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.298878] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.298991] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.299278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.299382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.299497] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91966b7c-171f-4c65-8a17-9eb277064959 is going to be created. [ 604.303425] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.332506] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.332648] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.332714] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.332923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.333099] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.344860] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91966b7c-171f-4c65-8a17-9eb277064959 in Status: UNINITIALIZED for 2s [ 604.399934] env[66519]: INFO networking_nsxv3.common.synchronization [None req-72403f27-22d1-4ddb-9454-b5bd67175631 tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 with Priority: HIGHEST for action security_group_rules [ 604.403213] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 with Priority: HIGHEST for action security_group_rules [ 604.403721] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8a24d0e-87af-4465-ae43-ca9c589fc6b0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.403893] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.585335] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47d9aeee-27b7-465a-8e0b-ac82c20d44c4 [ 604.585335] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.585335] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.585335] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.585662] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.588021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.588021] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47d9aeee-27b7-465a-8e0b-ac82c20d44c4 already deleted. [ 604.588021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47d9aeee-27b7-465a-8e0b-ac82c20d44c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.781755] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.781924] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.781974] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.782176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.782261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.782370] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 already deleted. [ 604.782470] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.782621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.782777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.782853] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8a24d0e-87af-4465-ae43-ca9c589fc6b0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.808865] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.809239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.809239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.809362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.809460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.809762] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5530bb2-b2db-4078-af78-1410edb05dd7 is going to be updated. [ 604.843606] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.843758] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.843813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.844083] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.844237] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.853993] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: IN_PROGRESS for 2s [ 605.280282] env[66519]: INFO networking_nsxv3.common.synchronization [req-59e7d41c-d553-47f2-b633-0210770e3a84 req-38063407-dd46-47fe-90f9-06248dc83583 tempest-SecurityGroupRulesTestJSON-2035222242 tempest-SecurityGroupRulesTestJSON-2035222242-project-member] Enqueued Resource ID: c103751a-e430-4384-aa50-358d983be42d with Priority: HIGHEST for action security_group_rules [ 605.281242] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c103751a-e430-4384-aa50-358d983be42d with Priority: HIGHEST for action security_group_rules [ 605.281242] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c103751a-e430-4384-aa50-358d983be42d taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.281450] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c103751a-e430-4384-aa50-358d983be42d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.281450] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c103751a-e430-4384-aa50-358d983be42d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.281776] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c103751a-e430-4384-aa50-358d983be42d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.281845] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c103751a-e430-4384-aa50-358d983be42d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.314046] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.314240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.314298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.314542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.314851] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.314851] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 already deleted. [ 605.314851] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.439311] env[66519]: INFO networking_nsxv3.common.synchronization [req-3f39ebf1-ea7c-416e-808b-7606ca3140e4 req-4011d112-e333-4e6c-a9ae-f273ed2d079e tempest-TenantUsagesTestJSON-1546157383 tempest-TenantUsagesTestJSON-1546157383-project-member] Enqueued Resource ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a with Priority: HIGHEST for action security_group_members [ 605.440039] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a with Priority: HIGHEST for action security_group_members [ 605.442449] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bb323a7-1c72-4a14-b96f-1b609dfc553a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.442606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.442693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.443126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.443208] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.443327] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.443395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.443594] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.443708] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.443831] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bb323a7-1c72-4a14-b96f-1b609dfc553a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.806524] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.806833] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.806941] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.807257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.807366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.807470] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c103751a-e430-4384-aa50-358d983be42d already deleted. [ 605.807580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c103751a-e430-4384-aa50-358d983be42d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.921409] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.922763] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.922763] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.922763] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.923109] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.926385] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.926385] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.926385] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.926385] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.926385] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.926385] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.926385] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.926385] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.926385] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.926385] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.926385] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.950028] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.950028] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 605.950028] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.950028] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.950028] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-c56c0b5c-b7a3-4130-994a-94211724669a taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.950028] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-c56c0b5c-b7a3-4130-994a-94211724669a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.950028] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-c56c0b5c-b7a3-4130-994a-94211724669a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.950028] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-c56c0b5c-b7a3-4130-994a-94211724669a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.950028] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c56c0b5c-b7a3-4130-994a-94211724669a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.951445] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.951812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.953281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.953281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.953281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.953281] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.953281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.953281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.953281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.953281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.953281] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a already deleted. [ 605.953281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.356073] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91966b7c-171f-4c65-8a17-9eb277064959 in Status: SUCCESS [ 606.356073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.356073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.356073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.356073] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.356073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.356315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.356345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.356491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.356571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.356720] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('91966b7c-171f-4c65-8a17-9eb277064959',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.457035] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.457035] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.457035] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.457035] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.457035] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.457035] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port c56c0b5c-b7a3-4130-994a-94211724669a not found, creating... [ 606.457035] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.457035] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.457035] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.457035] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.457035] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.457573] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.457573] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.458123] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.458650] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.458650] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.458813] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: c56c0b5c-b7a3-4130-994a-94211724669a is going to be created. [ 606.482337] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.482709] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.482933] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.483402] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.483717] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.484094] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-c56c0b5c-b7a3-4130-994a-94211724669a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.860335] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-91966b7c-171f-4c65-8a17-9eb277064959 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.860574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.860713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.860969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.861199] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.861304] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.861385] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.861583] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.861710] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.861853] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.862062] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-91966b7c-171f-4c65-8a17-9eb277064959 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.862204] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.862313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.862955] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.862955] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.862955] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.862955] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.863200] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.863200] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.863302] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.863469] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('91966b7c-171f-4c65-8a17-9eb277064959',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.864969] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: SUCCESS [ 606.865166] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.865318] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.865505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.865668] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.865772] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.865845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.865974] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.866077] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.866149] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.866295] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.866473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.866556] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.866679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.866820] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.866912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.866969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.867144] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.867254] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.867349] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.867476] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.189878] env[66519]: INFO networking_nsxv3.common.synchronization [req-3f39ebf1-ea7c-416e-808b-7606ca3140e4 req-5fca1a99-24c3-4952-9c77-fe45f3157d4b service nova] Enqueued Resource ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a with Priority: HIGHEST for action security_group_rules [ 607.190193] env[66519]: INFO networking_nsxv3.common.synchronization [req-3f39ebf1-ea7c-416e-808b-7606ca3140e4 req-5fca1a99-24c3-4952-9c77-fe45f3157d4b service nova] Enqueued Resource ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a with Priority: HIGHEST for action security_group_members [ 607.190193] env[66519]: INFO networking_nsxv3.common.synchronization [req-3f39ebf1-ea7c-416e-808b-7606ca3140e4 req-5fca1a99-24c3-4952-9c77-fe45f3157d4b service nova] Enqueued Resource ID: c56c0b5c-b7a3-4130-994a-94211724669a with Priority: HIGHEST for action port [ 607.190826] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a with Priority: HIGHEST for action security_group_rules [ 607.190826] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a with Priority: HIGHEST for action security_group_members [ 607.190826] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c56c0b5c-b7a3-4130-994a-94211724669a with Priority: HIGHEST for action port [ 607.191754] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bb323a7-1c72-4a14-b96f-1b609dfc553a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.191874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.191874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.192135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.192213] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bb323a7-1c72-4a14-b96f-1b609dfc553a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.194255] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bb323a7-1c72-4a14-b96f-1b609dfc553a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.194255] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.194255] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.194494] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.194494] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.194607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.194607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.198738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.198738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.198738] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bb323a7-1c72-4a14-b96f-1b609dfc553a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.198738] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-c56c0b5c-b7a3-4130-994a-94211724669a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.198738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c56c0b5c-b7a3-4130-994a-94211724669a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.198738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c56c0b5c-b7a3-4130-994a-94211724669a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.198738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c56c0b5c-b7a3-4130-994a-94211724669a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.198738] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c56c0b5c-b7a3-4130-994a-94211724669a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.355855] env[66519]: INFO networking_nsxv3.common.synchronization [req-23c71556-920e-4a6a-aa2a-590dc31d3910 req-9649107e-b696-4dbd-aba1-5cba33d4bc57 tempest-DeleteServersAdminTestJSON-940272462 tempest-DeleteServersAdminTestJSON-940272462-project-admin] Enqueued Resource ID: 6960f374-b898-4940-b626-d2d9b6819605 with Priority: HIGHEST for action security_group_members [ 607.356426] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6960f374-b898-4940-b626-d2d9b6819605 with Priority: HIGHEST for action security_group_members [ 607.356948] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6960f374-b898-4940-b626-d2d9b6819605 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.357372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.357454] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.357668] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.357829] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.357972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.358025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.358202] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.358279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.358376] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6960f374-b898-4940-b626-d2d9b6819605',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.369807] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 91966b7c-171f-4c65-8a17-9eb277064959: rpc.has_security_group_logging(os_id): False [ 607.371139] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5530bb2-b2db-4078-af78-1410edb05dd7: rpc.has_security_group_logging(os_id): False [ 607.391086] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.391194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.391281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.391457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.391541] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.391753] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.392615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.392615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.392615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.392615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.392615] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.392615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.392615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.392615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.392615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.393935] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.393935] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.393935] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.393935] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.393935] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.393935] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5530bb2-b2db-4078-af78-1410edb05dd7 is going to be created. [ 607.396903] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.397101] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.397101] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.397436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.397436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.397787] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.397787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.397787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.399911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.399911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.399911] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.399911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.399911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.399911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.399911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.399911] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.399911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.399911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.400435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.400435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.400435] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91966b7c-171f-4c65-8a17-9eb277064959 is going to be created. [ 607.476344] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.476457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.476457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.476704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.476913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.479763] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.479763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.479763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.479763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.479763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.482870] env[66519]: INFO networking_nsxv3.common.synchronization [req-3078b4f4-1a09-450d-a617-4926078533f5 req-bf44eeb2-6261-4a4f-b092-35d2d71e281e tempest-ServerAddressesTestJSON-495609721 tempest-ServerAddressesTestJSON-495609721-project-member] Enqueued Resource ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 with Priority: HIGHEST for action security_group_members [ 607.485022] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 with Priority: HIGHEST for action security_group_members [ 607.486042] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f40915ba-8560-4243-a90e-1d2bc4bfd564 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.486197] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.486272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.486556] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.486833] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.486833] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.486833] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.487278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.487313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.487569] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f40915ba-8560-4243-a90e-1d2bc4bfd564',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.495927] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91966b7c-171f-4c65-8a17-9eb277064959 in Status: IN_PROGRESS for 2s [ 607.496765] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: IN_PROGRESS for 2s [ 607.694898] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bb323a7-1c72-4a14-b96f-1b609dfc553a taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.694898] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.700299] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2bb323a7-1c72-4a14-b96f-1b609dfc553a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.702295] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c56c0b5c-b7a3-4130-994a-94211724669a with status ACTIVE [ 607.702521] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.702660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.702730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.704075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.704075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.704075] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.704075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.704075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.704075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.704075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.704075] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.704075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.704075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.704075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.704075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.704905] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c56c0b5c-b7a3-4130-994a-94211724669a is going to be updated. [ 607.733071] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.733279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.733329] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.734386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.734386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.734386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c56c0b5c-b7a3-4130-994a-94211724669a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.862333] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.863814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.863814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.863814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.863814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.863814] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.863814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.863814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.863814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.863814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.863814] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6960f374-b898-4940-b626-d2d9b6819605 is going to be updated. [ 607.870791] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-193 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.870988] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-193" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.871125] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-193" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.871788] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-193" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.872109] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.872275] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.872387] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.872687] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.872829] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.873046] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.873157] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.873266] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.873366] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.873470] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.873591] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.873686] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.907277] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.907502] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.907747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.907883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.908926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.911527] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.911761] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.911956] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.912219] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-193" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.912684] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-f38c690c-647f-4552-aff9-0946476e2ad3 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.914430] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-f38c690c-647f-4552-aff9-0946476e2ad3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.914430] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-f38c690c-647f-4552-aff9-0946476e2ad3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.914430] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-f38c690c-647f-4552-aff9-0946476e2ad3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.914430] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f38c690c-647f-4552-aff9-0946476e2ad3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.924310] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6960f374-b898-4940-b626-d2d9b6819605 in Status: IN_PROGRESS for 2s [ 607.989988] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.990181] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.990226] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.990462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.990543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.990741] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.990859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.990897] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.991059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.991133] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.991223] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 already deleted. [ 607.991291] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.203161] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2bb323a7-1c72-4a14-b96f-1b609dfc553a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.419221] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.419438] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.419488] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.420402] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.420402] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.420402] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port f38c690c-647f-4552-aff9-0946476e2ad3 not found, creating... [ 608.420402] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.420585] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.420585] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.420796] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.420921] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.421210] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.421380] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.422114] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.422114] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.422114] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.422252] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: f38c690c-647f-4552-aff9-0946476e2ad3 is going to be created. [ 608.454036] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.454566] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.454566] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.455163] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.455163] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.455309] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-f38c690c-647f-4552-aff9-0946476e2ad3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.706558] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.706558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.706558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.706558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.706558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.706558] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a is going to be created. [ 608.735036] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.735036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.735036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.735036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.735036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.760754] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a in Status: UNINITIALIZED for 2s [ 608.796140] env[66519]: INFO networking_nsxv3.common.synchronization [None req-76dcd5d1-e574-4909-8517-309a89ef5499 tempest-ServersWithSpecificFlavorTestJSON-1863263519 tempest-ServersWithSpecificFlavorTestJSON-1863263519-project-member] Enqueued Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_rules [ 608.797087] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_rules [ 608.797087] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-393aa0d3-c462-4737-b799-041054ed8323 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.797087] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.797912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.797912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.797912] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('393aa0d3-c462-4737-b799-041054ed8323',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.084956] env[66519]: INFO networking_nsxv3.common.synchronization [None req-9c670ba7-fc83-4bf2-9d1a-ee478fdbae5d tempest-ServersWithSpecificFlavorTestJSON-1863263519 tempest-ServersWithSpecificFlavorTestJSON-1863263519-project-member] Enqueued Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_rules [ 609.085856] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_rules [ 609.086527] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-393aa0d3-c462-4737-b799-041054ed8323 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.086610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.209205] env[66519]: INFO networking_nsxv3.common.synchronization [req-3078b4f4-1a09-450d-a617-4926078533f5 req-ad0b0dbf-bf63-43c0-bd23-5680f773584c service nova] Enqueued Resource ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 with Priority: HIGHEST for action security_group_rules [ 609.209440] env[66519]: INFO networking_nsxv3.common.synchronization [req-3078b4f4-1a09-450d-a617-4926078533f5 req-ad0b0dbf-bf63-43c0-bd23-5680f773584c service nova] Enqueued Resource ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 with Priority: HIGHEST for action security_group_members [ 609.209440] env[66519]: INFO networking_nsxv3.common.synchronization [req-3078b4f4-1a09-450d-a617-4926078533f5 req-ad0b0dbf-bf63-43c0-bd23-5680f773584c service nova] Enqueued Resource ID: f38c690c-647f-4552-aff9-0946476e2ad3 with Priority: HIGHEST for action port [ 609.209980] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 with Priority: HIGHEST for action security_group_rules [ 609.210127] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 with Priority: HIGHEST for action security_group_members [ 609.210213] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f38c690c-647f-4552-aff9-0946476e2ad3 with Priority: HIGHEST for action port [ 609.210478] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f40915ba-8560-4243-a90e-1d2bc4bfd564 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.210707] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.210707] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.210914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.211218] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f40915ba-8560-4243-a90e-1d2bc4bfd564',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.211985] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f40915ba-8560-4243-a90e-1d2bc4bfd564 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.212098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.212159] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.213009] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.213009] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.213009] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.213009] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.213009] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.213009] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.213009] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f40915ba-8560-4243-a90e-1d2bc4bfd564',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.215023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-f38c690c-647f-4552-aff9-0946476e2ad3 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.215023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f38c690c-647f-4552-aff9-0946476e2ad3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.215023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f38c690c-647f-4552-aff9-0946476e2ad3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.215023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f38c690c-647f-4552-aff9-0946476e2ad3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.215023] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f38c690c-647f-4552-aff9-0946476e2ad3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.328715] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.328887] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.328965] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.329183] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.329272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.329366] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 393aa0d3-c462-4737-b799-041054ed8323 already deleted. [ 609.329450] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.329602] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.329755] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.329839] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('393aa0d3-c462-4737-b799-041054ed8323',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.512251] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: SUCCESS [ 609.512251] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.513042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.513042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.513042] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.514659] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 91966b7c-171f-4c65-8a17-9eb277064959 in Status: SUCCESS [ 609.514784] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.596136] env[66519]: INFO networking_nsxv3.common.synchronization [req-4d1511bc-372b-4f8d-bd13-c16b2bc1a2cd req-0ae1d5b4-2665-4ec0-920d-cd92b8d1608d tempest-ServersTestMultiNic-666815749 tempest-ServersTestMultiNic-666815749-project-member] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 609.596345] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 609.596730] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.596883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.597042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.597908] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.597908] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.597908] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.597908] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.597908] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.597908] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.598187] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.716119] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f40915ba-8560-4243-a90e-1d2bc4bfd564',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.718428] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f40915ba-8560-4243-a90e-1d2bc4bfd564 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.718708] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.718922] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f38c690c-647f-4552-aff9-0946476e2ad3 with status ACTIVE [ 609.719145] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.719300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.719343] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.719539] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.719752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.719945] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.720053] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.720116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.720279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.720358] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.720540] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.720639] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.720729] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.720847] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.720961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.721012] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f38c690c-647f-4552-aff9-0946476e2ad3 is going to be updated. [ 609.748676] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.749597] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.749730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.749949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.750113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.750276] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f38c690c-647f-4552-aff9-0946476e2ad3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.878023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.878184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.878251] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.878476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.878542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.878611] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 393aa0d3-c462-4737-b799-041054ed8323 already deleted. [ 609.878710] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.937877] env[66519]: INFO networking_nsxv3.common.synchronization [req-4d1511bc-372b-4f8d-bd13-c16b2bc1a2cd req-59806cb1-4781-439f-bf20-08f920bd7c23 tempest-ServersTestMultiNic-666815749 tempest-ServersTestMultiNic-666815749-project-member] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 609.939774] env[66519]: INFO networking_nsxv3.common.synchronization [req-d553f045-4340-42c9-bcc1-f66bbd076cf5 req-eeb051c7-b126-4b47-a643-dac532cae42a tempest-SecurityGroupRulesTestJSON-2035222242 tempest-SecurityGroupRulesTestJSON-2035222242-project-member] Enqueued Resource ID: 9405b841-bdfc-4a29-a668-8cd184559a8d with Priority: HIGHEST for action security_group_rules [ 609.939774] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6960f374-b898-4940-b626-d2d9b6819605 in Status: SUCCESS [ 609.939774] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6960f374-b898-4940-b626-d2d9b6819605 deletion is rescheduled due to dependency. [ 609.939774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.939981] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 609.940129] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9405b841-bdfc-4a29-a668-8cd184559a8d with Priority: HIGHEST for action security_group_rules [ 609.940787] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.940787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.940787] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9405b841-bdfc-4a29-a668-8cd184559a8d taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.940974] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9405b841-bdfc-4a29-a668-8cd184559a8d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.940974] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9405b841-bdfc-4a29-a668-8cd184559a8d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.941693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9405b841-bdfc-4a29-a668-8cd184559a8d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.941693] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9405b841-bdfc-4a29-a668-8cd184559a8d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.015942] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.016794] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.016794] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.016794] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.016794] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.016794] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.016794] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.017115] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.017115] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.017115] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.017202] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.101142] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.101354] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.101415] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.101777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.101891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.102120] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.102214] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.102280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.102558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.102645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.102755] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac already deleted. [ 610.102842] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.103346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.103563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.103722] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.103820] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.103881] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.104192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.104310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.104493] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.218780] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f40915ba-8560-4243-a90e-1d2bc4bfd564',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.243268] env[66519]: INFO networking_nsxv3.common.synchronization [req-4d1511bc-372b-4f8d-bd13-c16b2bc1a2cd req-2ef5cbf6-947e-4ed7-9b7c-2033df627f96 tempest-ServersTestMultiNic-666815749 tempest-ServersTestMultiNic-666815749-project-member] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 610.243766] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 610.244087] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.244200] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.463370] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.463538] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.463613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.463825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.463930] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.464040] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9405b841-bdfc-4a29-a668-8cd184559a8d already deleted. [ 610.464125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9405b841-bdfc-4a29-a668-8cd184559a8d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.520966] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.521159] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.521235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.521456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.521686] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.521777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.521830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.522032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.522095] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.522199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.522357] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.522484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.522760] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.522760] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.523092] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.523092] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.523092] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.523194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.523194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.523298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.523414] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.600059] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-943 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.600242] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-943" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.600366] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-943" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.600729] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-943" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.601015] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.601249] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.601380] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.601700] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.601921] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.602147] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.602276] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 610.602377] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 610.602500] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 610.604090] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.604090] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 610.604090] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 610.607472] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.607609] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.607675] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.607912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.608041] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.608306] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.608454] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.608643] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.608836] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.608943] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.609060] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac already deleted. [ 610.609171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.609360] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.609637] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.609771] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.609891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.610231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.610231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.610231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.610358] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.625427] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 610.625644] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 610.625770] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 610.625941] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-943" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.626290] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-6b2b4e97-c2f1-4423-825c-ae94cbcfa3c3 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.626498] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-6b2b4e97-c2f1-4423-825c-ae94cbcfa3c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.626686] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-6b2b4e97-c2f1-4423-825c-ae94cbcfa3c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.627183] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-6b2b4e97-c2f1-4423-825c-ae94cbcfa3c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.627357] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b2b4e97-c2f1-4423-825c-ae94cbcfa3c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.721530] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.721708] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.721708] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.721930] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.722036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.722239] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 is going to be created. [ 610.748214] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.748393] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.748449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.748695] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.748923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.760165] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 in Status: UNINITIALIZED for 2s [ 610.769271] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a in Status: SUCCESS [ 610.769492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.769652] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.769861] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.770065] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.770185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.770251] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.770410] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.770508] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.770624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.770720] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2bb323a7-1c72-4a14-b96f-1b609dfc553a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.026578] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5530bb2-b2db-4078-af78-1410edb05dd7: rpc.has_security_group_logging(os_id): False [ 611.053062] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.053317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.053362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.053594] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.053689] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.053924] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.054151] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.054221] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.054392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.054508] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.054712] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.054809] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.054867] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.056169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.056169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.057619] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.057619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.057619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.057619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.057619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.057619] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5530bb2-b2db-4078-af78-1410edb05dd7 is going to be updated. [ 611.112972] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.112972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.112972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.113833] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.117090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.117090] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.117090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.117090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.117090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.117090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.117090] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac already deleted. [ 611.117090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.129533] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.130900] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.130900] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.130900] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.130900] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.130900] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 6b2b4e97-c2f1-4423-825c-ae94cbcfa3c3 not found, creating... [ 611.131388] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.131388] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.131388] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.131758] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.131758] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.132082] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.132455] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.132648] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.132966] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.133209] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.133495] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 6b2b4e97-c2f1-4423-825c-ae94cbcfa3c3 is going to be created. [ 611.135648] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.135771] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.135845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.136018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.137420] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.158125] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: IN_PROGRESS for 2s [ 611.180133] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.181995] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.181995] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.181995] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.181995] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.182584] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-6b2b4e97-c2f1-4423-825c-ae94cbcfa3c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.273067] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bb323a7-1c72-4a14-b96f-1b609dfc553a taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.273401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.273512] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.273825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.274095] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.274256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.274458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.274566] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.274680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.274801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.275014] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bb323a7-1c72-4a14-b96f-1b609dfc553a taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.275142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.275226] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.275413] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.275604] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.275737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.275823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.276035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.276157] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.276293] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.276436] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2bb323a7-1c72-4a14-b96f-1b609dfc553a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.779802] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2bb323a7-1c72-4a14-b96f-1b609dfc553a: rpc.has_security_group_logging(os_id): False [ 611.799043] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.799188] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.799264] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.799476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.799566] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.799776] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.800417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.800417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.800417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.800417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.800417] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.800417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.800788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.800788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.800788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.800881] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.800970] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.802231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.802392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.802543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.802586] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a is going to be created. [ 611.861536] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.861732] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.861845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.862182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.862462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.868453] env[66519]: INFO networking_nsxv3.common.synchronization [req-4d1511bc-372b-4f8d-bd13-c16b2bc1a2cd req-7fa571fc-6761-4534-9239-2ef935b995f4 service nova] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_rules [ 611.868708] env[66519]: INFO networking_nsxv3.common.synchronization [req-4d1511bc-372b-4f8d-bd13-c16b2bc1a2cd req-7fa571fc-6761-4534-9239-2ef935b995f4 service nova] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 611.868912] env[66519]: INFO networking_nsxv3.common.synchronization [req-4d1511bc-372b-4f8d-bd13-c16b2bc1a2cd req-7fa571fc-6761-4534-9239-2ef935b995f4 service nova] Enqueued Resource ID: 6b2b4e97-c2f1-4423-825c-ae94cbcfa3c3 with Priority: HIGHEST for action port [ 611.869584] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_rules [ 611.870015] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 611.870164] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b2b4e97-c2f1-4423-825c-ae94cbcfa3c3 with Priority: HIGHEST for action port [ 611.870519] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.870683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.870938] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.871141] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.871285] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.872890] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.873016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.873125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.873384] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.873665] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.873750] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.873847] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.874162] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.874310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.874506] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.875693] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b2b4e97-c2f1-4423-825c-ae94cbcfa3c3 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.875787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b2b4e97-c2f1-4423-825c-ae94cbcfa3c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.875887] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b2b4e97-c2f1-4423-825c-ae94cbcfa3c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.876126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b2b4e97-c2f1-4423-825c-ae94cbcfa3c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.876366] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b2b4e97-c2f1-4423-825c-ae94cbcfa3c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.878131] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a in Status: IN_PROGRESS for 2s [ 612.203928] env[66519]: INFO networking_nsxv3.common.synchronization [req-71996ce0-360f-484d-bca6-c1d02d1341e8 req-8bfac18a-a0c1-48d8-b33b-b1cb06f4ecb8 tempest-VolumesAssistedSnapshotsTest-1753704316 tempest-VolumesAssistedSnapshotsTest-1753704316-project-member] Enqueued Resource ID: facac47b-64fc-4659-9f54-1cb6066b4b88 with Priority: HIGHEST for action security_group_members [ 612.206211] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: facac47b-64fc-4659-9f54-1cb6066b4b88 with Priority: HIGHEST for action security_group_members [ 612.206211] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-facac47b-64fc-4659-9f54-1cb6066b4b88 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.206211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.206211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.206211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.206211] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.206211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.206211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.206211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.206211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.206750] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('facac47b-64fc-4659-9f54-1cb6066b4b88',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.379442] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.379442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.379442] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.380951] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b2b4e97-c2f1-4423-825c-ae94cbcfa3c3 with status ACTIVE [ 612.381158] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.381795] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.381795] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.381795] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.381795] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.381795] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.383205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.383284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.383454] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.383554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.383769] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.383884] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.383957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.384131] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.385306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.385456] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b2b4e97-c2f1-4423-825c-ae94cbcfa3c3 is going to be updated. [ 612.409667] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.410253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.410379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.410605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.410744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.410912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b2b4e97-c2f1-4423-825c-ae94cbcfa3c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.682908] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-270 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.682908] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-270" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.682908] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-270" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.683216] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-270" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.683396] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.684566] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.684566] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.684566] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.684566] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.684566] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.684566] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.685065] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.685065] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.685065] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.685065] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.685065] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.705087] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.705087] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 612.705087] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.705087] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-270" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.705087] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-6893ebea-6cff-4741-81e8-ec60819e029a taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.705087] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-6893ebea-6cff-4741-81e8-ec60819e029a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.705087] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-6893ebea-6cff-4741-81e8-ec60819e029a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.705365] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-6893ebea-6cff-4741-81e8-ec60819e029a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.705365] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6893ebea-6cff-4741-81e8-ec60819e029a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.707858] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-250 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.708297] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-250" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.708297] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-250" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.708455] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-250" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.708919] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.709080] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.709887] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.709887] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.709887] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.709887] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.709887] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.710182] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.710182] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.710286] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.710355] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.710474] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.712097] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.712223] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.712307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.712474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.712554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.712914] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.713030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.713095] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.713239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.713315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.713561] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: facac47b-64fc-4659-9f54-1cb6066b4b88 already deleted. [ 612.713677] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.732508] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.732664] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 612.732825] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.733065] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-250" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.733372] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-def1dfb6-efbe-4aae-82a1-932f63afc3d0 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.733510] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-def1dfb6-efbe-4aae-82a1-932f63afc3d0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.733705] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-def1dfb6-efbe-4aae-82a1-932f63afc3d0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.733994] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-def1dfb6-efbe-4aae-82a1-932f63afc3d0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.734204] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('def1dfb6-efbe-4aae-82a1-932f63afc3d0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.770849] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 in Status: SUCCESS [ 612.771257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.771506] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.771814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.772109] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.772407] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.772484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.772714] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.772821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.772919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.773090] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f40915ba-8560-4243-a90e-1d2bc4bfd564',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.887604] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.173517] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: SUCCESS [ 613.173748] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.173926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.174175] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.174267] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.213045] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.213279] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.213409] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.213709] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.213857] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.214022] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 6893ebea-6cff-4741-81e8-ec60819e029a not found, creating... [ 613.214356] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.214617] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.214813] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.215101] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.215241] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.215595] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.215869] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.215987] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.216228] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.216363] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.216503] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 6893ebea-6cff-4741-81e8-ec60819e029a is going to be created. [ 613.237180] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.237404] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.237513] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.237788] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.237926] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.238101] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port def1dfb6-efbe-4aae-82a1-932f63afc3d0 not found, creating... [ 613.238377] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.238532] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.238652] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.238899] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.239048] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.239323] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.239476] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.239589] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.239792] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.239918] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.240061] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: def1dfb6-efbe-4aae-82a1-932f63afc3d0 is going to be created. [ 613.242096] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.242266] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.242492] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.242686] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.242895] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.243124] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-6893ebea-6cff-4741-81e8-ec60819e029a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.271160] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.271473] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.271562] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.271814] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.272067] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.272321] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-def1dfb6-efbe-4aae-82a1-932f63afc3d0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.275086] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f40915ba-8560-4243-a90e-1d2bc4bfd564 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.275265] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.275355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.275603] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.275810] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.275919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.275968] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.276182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.276311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.276540] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.276649] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f40915ba-8560-4243-a90e-1d2bc4bfd564 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.276723] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.276776] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.276919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.277074] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.277249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.277249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.277458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.277458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.277564] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.277614] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f40915ba-8560-4243-a90e-1d2bc4bfd564',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.390222] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.390635] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.390635] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.390778] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.390778] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.390877] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac is going to be created. [ 613.426063] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.426287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.426287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.426556] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.426670] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.443795] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: UNINITIALIZED for 2s [ 613.677038] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.677227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.677227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.677437] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.677607] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.677740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.677805] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.677961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.678063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.678150] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.678239] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.779638] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f40915ba-8560-4243-a90e-1d2bc4bfd564: rpc.has_security_group_logging(os_id): False [ 613.800516] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.800756] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.800756] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.801163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.801163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.801471] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.801623] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.801705] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.801830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.801919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.802208] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.802354] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.802692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.802755] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.802872] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.803164] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.803331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.803424] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.803632] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.803632] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.803795] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 is going to be created. [ 613.892957] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.893247] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.893247] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.893402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.893613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.898797] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a in Status: SUCCESS [ 613.898797] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.907506] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 in Status: IN_PROGRESS for 2s [ 613.985088] env[66519]: INFO networking_nsxv3.common.synchronization [req-71996ce0-360f-484d-bca6-c1d02d1341e8 req-8ff8eebb-8fcc-4477-9ded-28625cfa4abc service nova] Enqueued Resource ID: facac47b-64fc-4659-9f54-1cb6066b4b88 with Priority: HIGHEST for action security_group_rules [ 613.985271] env[66519]: INFO networking_nsxv3.common.synchronization [req-71996ce0-360f-484d-bca6-c1d02d1341e8 req-8ff8eebb-8fcc-4477-9ded-28625cfa4abc service nova] Enqueued Resource ID: facac47b-64fc-4659-9f54-1cb6066b4b88 with Priority: HIGHEST for action security_group_members [ 613.985401] env[66519]: INFO networking_nsxv3.common.synchronization [req-71996ce0-360f-484d-bca6-c1d02d1341e8 req-8ff8eebb-8fcc-4477-9ded-28625cfa4abc service nova] Enqueued Resource ID: 6893ebea-6cff-4741-81e8-ec60819e029a with Priority: HIGHEST for action port [ 613.985967] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: facac47b-64fc-4659-9f54-1cb6066b4b88 with Priority: HIGHEST for action security_group_rules [ 613.986764] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: facac47b-64fc-4659-9f54-1cb6066b4b88 with Priority: HIGHEST for action security_group_members [ 613.986992] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6893ebea-6cff-4741-81e8-ec60819e029a with Priority: HIGHEST for action port [ 613.987295] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-facac47b-64fc-4659-9f54-1cb6066b4b88 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.987556] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.987556] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.987883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.987969] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('facac47b-64fc-4659-9f54-1cb6066b4b88',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.989801] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-facac47b-64fc-4659-9f54-1cb6066b4b88 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.989885] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.990029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.990119] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.990266] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.990354] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.990410] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.990556] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.990634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.990725] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('facac47b-64fc-4659-9f54-1cb6066b4b88',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.996437] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-6893ebea-6cff-4741-81e8-ec60819e029a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.996437] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6893ebea-6cff-4741-81e8-ec60819e029a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.996437] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6893ebea-6cff-4741-81e8-ec60819e029a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.996437] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6893ebea-6cff-4741-81e8-ec60819e029a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.996437] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6893ebea-6cff-4741-81e8-ec60819e029a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.997107] env[66519]: INFO networking_nsxv3.common.synchronization [req-4d1511bc-372b-4f8d-bd13-c16b2bc1a2cd req-b1b09eba-df00-4659-82bf-6b07eb6d39f3 service nova] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_rules [ 613.997313] env[66519]: INFO networking_nsxv3.common.synchronization [req-4d1511bc-372b-4f8d-bd13-c16b2bc1a2cd req-b1b09eba-df00-4659-82bf-6b07eb6d39f3 service nova] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 613.997489] env[66519]: INFO networking_nsxv3.common.synchronization [req-4d1511bc-372b-4f8d-bd13-c16b2bc1a2cd req-b1b09eba-df00-4659-82bf-6b07eb6d39f3 service nova] Enqueued Resource ID: def1dfb6-efbe-4aae-82a1-932f63afc3d0 with Priority: HIGHEST for action port [ 613.999453] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_rules [ 614.001021] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 614.001197] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: def1dfb6-efbe-4aae-82a1-932f63afc3d0 with Priority: HIGHEST for action port [ 614.001585] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.001715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.002558] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.002666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.002822] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-def1dfb6-efbe-4aae-82a1-932f63afc3d0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.003050] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-def1dfb6-efbe-4aae-82a1-932f63afc3d0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.003050] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-def1dfb6-efbe-4aae-82a1-932f63afc3d0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.003233] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-def1dfb6-efbe-4aae-82a1-932f63afc3d0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.003280] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('def1dfb6-efbe-4aae-82a1-932f63afc3d0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.181262] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.181456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.181588] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.181730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.181913] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.182036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.182105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.182265] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.182353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.182448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.182674] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.182820] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.182924] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.183245] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.183408] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.183540] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.183627] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.183780] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.183879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.183983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.184087] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.445263] env[66519]: INFO networking_nsxv3.common.synchronization [req-dd5b2e3c-0608-48ca-a095-b97c81c07cee req-f56ca0a4-c390-4a99-9b7f-2cb7af516b4f tempest-ServerDiagnosticsNegativeTest-1592588629 tempest-ServerDiagnosticsNegativeTest-1592588629-project-member] Enqueued Resource ID: bb0d178a-aa94-4307-b6dd-b216489030fb with Priority: HIGHEST for action security_group_members [ 614.445897] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb0d178a-aa94-4307-b6dd-b216489030fb with Priority: HIGHEST for action security_group_members [ 614.446699] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb0d178a-aa94-4307-b6dd-b216489030fb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.446878] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.446985] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.447276] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.447487] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.447644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.447754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.447956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.452291] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.452411] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb0d178a-aa94-4307-b6dd-b216489030fb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.491229] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-facac47b-64fc-4659-9f54-1cb6066b4b88 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.491229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.494496] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('facac47b-64fc-4659-9f54-1cb6066b4b88',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.502969] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6893ebea-6cff-4741-81e8-ec60819e029a with status ACTIVE [ 614.502969] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.502969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.502969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.502969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.502969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.502969] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.502969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.502969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.502969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.502969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.502969] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.502969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.502969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.502969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.502969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.502969] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6893ebea-6cff-4741-81e8-ec60819e029a is going to be updated. [ 614.505874] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port def1dfb6-efbe-4aae-82a1-932f63afc3d0 with status ACTIVE [ 614.509467] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.509609] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.509722] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.511160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.511160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.511160] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.511160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.511160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.511160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.511160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.511160] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.511160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.511683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.511683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.511683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.511683] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: def1dfb6-efbe-4aae-82a1-932f63afc3d0 is going to be updated. [ 614.533852] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.533852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.533852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.533852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.533852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.533852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6893ebea-6cff-4741-81e8-ec60819e029a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.538219] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.538573] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.538699] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.538949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.539188] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.540502] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-def1dfb6-efbe-4aae-82a1-932f63afc3d0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.686948] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5530bb2-b2db-4078-af78-1410edb05dd7: rpc.has_security_group_logging(os_id): False [ 614.710514] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.710667] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.710759] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.711016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.711120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.711368] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.711478] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.711569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.711773] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.711883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.712129] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.712241] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.712480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.712480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.712480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.712980] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.712980] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.712980] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.712980] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.713345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.713345] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5530bb2-b2db-4078-af78-1410edb05dd7 is going to be updated. [ 614.743579] env[66519]: INFO networking_nsxv3.common.synchronization [req-1a64bb02-592e-4497-891e-8a074d1dcddc req-f1f6087e-09cc-4804-a27b-5a9550335b5b tempest-MigrationsAdminTest-1659008040 tempest-MigrationsAdminTest-1659008040-project-member] Enqueued Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGHEST for action security_group_members [ 614.744183] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGHEST for action security_group_members [ 614.744449] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.744605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.744671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.744949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.745127] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.745233] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.745293] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.745454] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.745541] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.745693] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.789616] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.789616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.789616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.789864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.789897] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.805984] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: IN_PROGRESS for 2s [ 614.925291] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-943 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.925564] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-943" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.925876] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-943" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.926228] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-943" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.926550] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.926759] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.926838] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.927109] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.927247] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.927442] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.927566] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.927665] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.927738] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.927840] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.927935] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.928085] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.954715] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.954894] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.954894] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.955138] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.955231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.955429] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.955663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.955663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.955782] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.955821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.955914] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb0d178a-aa94-4307-b6dd-b216489030fb is going to be updated. [ 614.996847] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('facac47b-64fc-4659-9f54-1cb6066b4b88',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.040456] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.040456] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.112 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 615.040620] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.040739] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-943" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.041067] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-fb51ce6f-6bfd-494e-b54a-50b6365a4e4c taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.041280] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-fb51ce6f-6bfd-494e-b54a-50b6365a4e4c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.041410] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-fb51ce6f-6bfd-494e-b54a-50b6365a4e4c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.041735] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-fb51ce6f-6bfd-494e-b54a-50b6365a4e4c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.041946] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb51ce6f-6bfd-494e-b54a-50b6365a4e4c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.052945] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.052945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.052945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.052945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.053222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.063437] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb0d178a-aa94-4307-b6dd-b216489030fb in Status: IN_PROGRESS for 2s [ 615.248252] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.248478] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.248523] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.248855] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.249026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.249351] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.249454] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.249545] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.249779] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.249897] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.250043] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cb7c090-e083-487a-aa5d-420200af9bce already deleted. [ 615.250139] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.332247] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.332488] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.332571] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.332837] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.333104] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.333448] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.333576] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.333804] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.334061] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.334256] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.334367] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.334504] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.334605] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.334714] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.334855] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.334981] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.396439] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.396693] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.062 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 615.396844] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.397063] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.397391] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-f80fdebe-3f57-4a3b-b1e9-fa43f4a4022e taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.397587] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-f80fdebe-3f57-4a3b-b1e9-fa43f4a4022e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.397712] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-f80fdebe-3f57-4a3b-b1e9-fa43f4a4022e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.398125] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-f80fdebe-3f57-4a3b-b1e9-fa43f4a4022e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.398274] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f80fdebe-3f57-4a3b-b1e9-fa43f4a4022e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.458148] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: SUCCESS [ 615.458561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.458561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.458779] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.459060] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.459157] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.459234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.459395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.459478] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.459578] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.459673] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.460597] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.460762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.460932] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.461048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.461111] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.461306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.461396] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.461486] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.499165] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.499401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.499401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.499571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.499664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.499772] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: facac47b-64fc-4659-9f54-1cb6066b4b88 is going to be created. [ 615.526232] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.526442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.526442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.526684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.527312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.537458] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: facac47b-64fc-4659-9f54-1cb6066b4b88 in Status: UNINITIALIZED for 2s [ 615.544419] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.544705] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.544826] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.545094] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.545240] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.545374] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port fb51ce6f-6bfd-494e-b54a-50b6365a4e4c not found, creating... [ 615.545773] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.545883] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.546008] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.546216] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.546376] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.546614] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.546762] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.546871] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.547085] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.547214] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.547361] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: fb51ce6f-6bfd-494e-b54a-50b6365a4e4c is going to be created. [ 615.567195] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.567407] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.567483] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.567754] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.567980] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.568228] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-fb51ce6f-6bfd-494e-b54a-50b6365a4e4c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.903028] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.903028] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.903028] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.903028] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.903028] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.903028] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port f80fdebe-3f57-4a3b-b1e9-fa43f4a4022e not found, creating... [ 615.903028] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.903028] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.903028] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.903625] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.903625] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.903625] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.903735] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.903858] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.904050] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.904187] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.904318] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: f80fdebe-3f57-4a3b-b1e9-fa43f4a4022e is going to be created. [ 615.920587] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 in Status: SUCCESS [ 615.920830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.925578] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.925837] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.925902] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.926212] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.926427] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.926677] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-f80fdebe-3f57-4a3b-b1e9-fa43f4a4022e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.963630] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.963849] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.963994] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.243774] env[66519]: INFO networking_nsxv3.common.synchronization [req-4d1511bc-372b-4f8d-bd13-c16b2bc1a2cd req-dd351888-2cf1-4c9b-a503-f501c12b46b4 service nova] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_rules [ 616.243990] env[66519]: INFO networking_nsxv3.common.synchronization [req-4d1511bc-372b-4f8d-bd13-c16b2bc1a2cd req-dd351888-2cf1-4c9b-a503-f501c12b46b4 service nova] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 616.244143] env[66519]: INFO networking_nsxv3.common.synchronization [req-4d1511bc-372b-4f8d-bd13-c16b2bc1a2cd req-dd351888-2cf1-4c9b-a503-f501c12b46b4 service nova] Enqueued Resource ID: fb51ce6f-6bfd-494e-b54a-50b6365a4e4c with Priority: HIGHEST for action port [ 616.244821] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_rules [ 616.244960] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 616.245223] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb51ce6f-6bfd-494e-b54a-50b6365a4e4c with Priority: HIGHEST for action port [ 616.245641] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.245792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.246073] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.246246] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.246483] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb51ce6f-6bfd-494e-b54a-50b6365a4e4c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.246652] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb51ce6f-6bfd-494e-b54a-50b6365a4e4c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.246759] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb51ce6f-6bfd-494e-b54a-50b6365a4e4c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.247023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb51ce6f-6bfd-494e-b54a-50b6365a4e4c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.247158] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb51ce6f-6bfd-494e-b54a-50b6365a4e4c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.466848] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.523565] env[66519]: INFO networking_nsxv3.common.synchronization [req-d6986069-473b-4fd0-bc09-d085cfb15140 req-b88bfa2e-29fe-467b-bb0f-f5f437da58f0 tempest-ListServersNegativeTestJSON-1730331396 tempest-ListServersNegativeTestJSON-1730331396-project-member] Enqueued Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_members [ 616.524244] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_members [ 616.524244] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.524427] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.524546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.525016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.525016] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.525131] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.525687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.525687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.525687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.525687] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.625193] env[66519]: INFO networking_nsxv3.common.synchronization [req-1a64bb02-592e-4497-891e-8a074d1dcddc req-e4122c79-8373-4ae8-a08b-21790e9c1cd3 service nova] Enqueued Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGHEST for action security_group_rules [ 616.625193] env[66519]: INFO networking_nsxv3.common.synchronization [req-1a64bb02-592e-4497-891e-8a074d1dcddc req-e4122c79-8373-4ae8-a08b-21790e9c1cd3 service nova] Enqueued Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGHEST for action security_group_members [ 616.625193] env[66519]: INFO networking_nsxv3.common.synchronization [req-1a64bb02-592e-4497-891e-8a074d1dcddc req-e4122c79-8373-4ae8-a08b-21790e9c1cd3 service nova] Enqueued Resource ID: f80fdebe-3f57-4a3b-b1e9-fa43f4a4022e with Priority: HIGHEST for action port [ 616.625193] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGHEST for action security_group_rules [ 616.625193] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGHEST for action security_group_members [ 616.625193] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f80fdebe-3f57-4a3b-b1e9-fa43f4a4022e with Priority: HIGHEST for action port [ 616.625587] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.625927] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.626187] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.626536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.626732] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.628264] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.628573] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.628724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.628995] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.630018] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.630018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.630018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.630018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.630018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.630018] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.630997] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-f80fdebe-3f57-4a3b-b1e9-fa43f4a4022e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.631291] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f80fdebe-3f57-4a3b-b1e9-fa43f4a4022e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.631459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f80fdebe-3f57-4a3b-b1e9-fa43f4a4022e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.633129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f80fdebe-3f57-4a3b-b1e9-fa43f4a4022e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.633129] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f80fdebe-3f57-4a3b-b1e9-fa43f4a4022e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.751389] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb51ce6f-6bfd-494e-b54a-50b6365a4e4c with status ACTIVE [ 616.757674] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.757674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.757674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.757674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.757674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.757674] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.757674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.757674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.757674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.757674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.757674] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.757674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.757674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.757674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.757674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.757674] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb51ce6f-6bfd-494e-b54a-50b6365a4e4c is going to be updated. [ 616.779415] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.779565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.779616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.779825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.779994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.780183] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb51ce6f-6bfd-494e-b54a-50b6365a4e4c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.825107] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: SUCCESS [ 616.825342] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.971724] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.971724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.971724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.971724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.971724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.971724] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac is going to be updated. [ 617.017312] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.017536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.017536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.017747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.017893] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.029182] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: IN_PROGRESS for 2s [ 617.029421] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.074575] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb0d178a-aa94-4307-b6dd-b216489030fb in Status: SUCCESS [ 617.075297] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb0d178a-aa94-4307-b6dd-b216489030fb deletion is rescheduled due to dependency. [ 617.075492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.134231] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.134231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.134231] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.134714] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f80fdebe-3f57-4a3b-b1e9-fa43f4a4022e with status ACTIVE [ 617.135036] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.135036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.135339] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.135339] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.135486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.135524] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.135630] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.135664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.135827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.135894] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.136096] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.136168] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.136202] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.137038] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.137038] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.137038] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f80fdebe-3f57-4a3b-b1e9-fa43f4a4022e is going to be updated. [ 617.158548] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.158548] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.158548] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.158820] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.158880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.160034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f80fdebe-3f57-4a3b-b1e9-fa43f4a4022e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.532452] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.550551] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: facac47b-64fc-4659-9f54-1cb6066b4b88 in Status: SUCCESS [ 617.550796] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.551378] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.551621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.551822] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.551942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.551999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.552178] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.552258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.552345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.552533] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('facac47b-64fc-4659-9f54-1cb6066b4b88',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.639224] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.035889] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.039015] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.039015] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.039015] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.039015] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.039015] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5530bb2-b2db-4078-af78-1410edb05dd7 is going to be updated. [ 618.057335] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('facac47b-64fc-4659-9f54-1cb6066b4b88',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.071334] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.071410] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.071474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.071777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.071928] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.082608] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: IN_PROGRESS for 2s [ 618.141065] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.141297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.141297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.141541] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.141601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.141689] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cb7c090-e083-487a-aa5d-420200af9bce is going to be created. [ 618.165634] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.165838] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.165936] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.166194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.166352] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.176898] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cb7c090-e083-487a-aa5d-420200af9bce in Status: UNINITIALIZED for 2s [ 618.560972] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for facac47b-64fc-4659-9f54-1cb6066b4b88: rpc.has_security_group_logging(os_id): False [ 618.581459] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.581645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.581708] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.581871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.581962] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.582279] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.582455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.582519] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.583462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.583462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.583462] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: facac47b-64fc-4659-9f54-1cb6066b4b88 is going to be created. [ 618.651765] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.651765] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.651765] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.651765] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.651765] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.663924] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: facac47b-64fc-4659-9f54-1cb6066b4b88 in Status: IN_PROGRESS for 2s [ 618.851528] env[66519]: INFO networking_nsxv3.common.synchronization [req-a46091f0-3187-442c-b1d2-9089949e8080 req-c9220dc4-2f04-4c0a-9485-d08d91282e4f tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 with Priority: HIGHEST for action security_group_members [ 618.852184] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 with Priority: HIGHEST for action security_group_members [ 618.852517] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.852660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.852761] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.853631] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.853857] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.854200] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.854421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.854778] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.854963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.855226] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8a24d0e-87af-4465-ae43-ca9c589fc6b0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.056392] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: SUCCESS [ 619.056392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.056392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.056392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.056392] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.056392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.056392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.056392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.056392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.056392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.056392] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.056392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.056392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.056392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.056392] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.056392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.056392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.057500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.057500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.057500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.057500] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.057738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.058430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.058430] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.058430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.058430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.058430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.058430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.058430] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.240113] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.240300] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.240417] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.241077] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.241077] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.241217] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.241296] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.241564] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.241564] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.241848] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.241961] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.242073] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.242175] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.242276] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.242372] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.242661] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.270403] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.270597] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 619.270777] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.271052] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.271452] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-9754e6d6-3157-4b5e-afef-6b368af34105 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.272053] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-9754e6d6-3157-4b5e-afef-6b368af34105" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.272053] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-9754e6d6-3157-4b5e-afef-6b368af34105" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.272340] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-9754e6d6-3157-4b5e-afef-6b368af34105" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.272552] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9754e6d6-3157-4b5e-afef-6b368af34105',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.361622] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.361622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.361622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.361622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.361622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.361622] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.361622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.361622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.361622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.361622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.361622] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 already deleted. [ 619.361622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.560405] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 376a7ea3-3e4d-4872-be2f-8bc029c25fac: rpc.has_security_group_logging(os_id): False [ 619.561546] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.580958] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.581125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.581198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.581410] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.581501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.581706] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.581805] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.581876] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.582044] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.582120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.582303] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.582395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.582451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.582586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.582655] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.582836] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.582926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.582985] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.584491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.584635] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.584729] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac is going to be created. [ 619.653294] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.653450] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.653534] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.653788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.654048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.668859] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: IN_PROGRESS for 2s [ 619.779997] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.780234] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.780358] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.780960] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.781186] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.781352] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 9754e6d6-3157-4b5e-afef-6b368af34105 not found, creating... [ 619.781621] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.781936] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.781936] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.782122] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.782248] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.782555] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.782691] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.782799] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.783018] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.783144] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.783273] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 9754e6d6-3157-4b5e-afef-6b368af34105 is going to be created. [ 619.814702] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.814967] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.815100] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.815440] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.815631] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.815860] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-9754e6d6-3157-4b5e-afef-6b368af34105" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.064421] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.092395] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: SUCCESS [ 620.092635] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.189914] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cb7c090-e083-487a-aa5d-420200af9bce in Status: SUCCESS [ 620.190455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.190455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.190577] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.190793] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.190923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.191017] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.191235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.191318] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.191407] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.191504] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.526396] env[66519]: INFO networking_nsxv3.common.synchronization [req-a46091f0-3187-442c-b1d2-9089949e8080 req-1de1b8d5-f9bb-4609-b6ec-02479c9a265d service nova] Enqueued Resource ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 with Priority: HIGHEST for action security_group_rules [ 620.526600] env[66519]: INFO networking_nsxv3.common.synchronization [req-a46091f0-3187-442c-b1d2-9089949e8080 req-1de1b8d5-f9bb-4609-b6ec-02479c9a265d service nova] Enqueued Resource ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 with Priority: HIGHEST for action security_group_members [ 620.526703] env[66519]: INFO networking_nsxv3.common.synchronization [req-a46091f0-3187-442c-b1d2-9089949e8080 req-1de1b8d5-f9bb-4609-b6ec-02479c9a265d service nova] Enqueued Resource ID: 9754e6d6-3157-4b5e-afef-6b368af34105 with Priority: HIGHEST for action port [ 620.527295] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 with Priority: HIGHEST for action security_group_rules [ 620.527440] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 with Priority: HIGHEST for action security_group_members [ 620.527534] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9754e6d6-3157-4b5e-afef-6b368af34105 with Priority: HIGHEST for action port [ 620.527816] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c8a24d0e-87af-4465-ae43-ca9c589fc6b0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.528073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.528073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.528241] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.528328] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c8a24d0e-87af-4465-ae43-ca9c589fc6b0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.529626] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.529772] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.529836] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.530500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.530703] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.530807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.530944] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.531224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.531317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.531810] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8a24d0e-87af-4465-ae43-ca9c589fc6b0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.533312] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-9754e6d6-3157-4b5e-afef-6b368af34105 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.533427] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9754e6d6-3157-4b5e-afef-6b368af34105" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.533734] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9754e6d6-3157-4b5e-afef-6b368af34105" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.533734] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9754e6d6-3157-4b5e-afef-6b368af34105" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.533837] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9754e6d6-3157-4b5e-afef-6b368af34105',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.566456] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.566833] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.566833] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.567297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.567448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.567902] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac is going to be updated. [ 620.603023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.603206] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.603276] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.603542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.603699] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.614172] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: IN_PROGRESS for 2s [ 620.679024] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: facac47b-64fc-4659-9f54-1cb6066b4b88 in Status: SUCCESS [ 620.679328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.695802] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.695802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.695802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.696364] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.696703] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.697294] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.697294] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.697367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.697799] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.697799] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.697799] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.697969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.697969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.698193] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.698342] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.698455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.698591] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.698693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.698820] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.698943] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.699830] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.036629] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c8a24d0e-87af-4465-ae43-ca9c589fc6b0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.040404] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.040625] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.040879] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9754e6d6-3157-4b5e-afef-6b368af34105 with status ACTIVE [ 621.041138] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.041294] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.041372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.041666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.041821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.042031] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.042171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.042257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.042463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.042562] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.042833] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.042961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.043055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.043243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.043493] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.043652] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9754e6d6-3157-4b5e-afef-6b368af34105 is going to be updated. [ 621.070085] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.070286] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.070354] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.070755] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.070934] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.071314] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9754e6d6-3157-4b5e-afef-6b368af34105" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.202794] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6cb7c090-e083-487a-aa5d-420200af9bce: rpc.has_security_group_logging(os_id): False [ 621.233067] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.233067] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.233067] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.234049] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.234049] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.234049] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.234049] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.235980] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.236898] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.236898] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.236898] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.236898] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.237187] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.237374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.237721] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.237849] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.238081] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.238494] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.238494] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.238555] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.239458] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cb7c090-e083-487a-aa5d-420200af9bce is going to be created. [ 621.352870] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.352870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.352870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.352870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.352870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.369717] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cb7c090-e083-487a-aa5d-420200af9bce in Status: IN_PROGRESS for 2s [ 621.545811] env[66519]: INFO networking_nsxv3.common.synchronization [None req-b7325ab8-e579-4f33-84d9-939fae0e97ad None None] Enqueued Resource ID: fea2e72b-e28b-4734-a711-77ecbf28dc21 with Priority: HIGHEST for action port [ 621.545811] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fea2e72b-e28b-4734-a711-77ecbf28dc21 with Priority: HIGHEST for action port [ 621.545811] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-fea2e72b-e28b-4734-a711-77ecbf28dc21 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.545811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fea2e72b-e28b-4734-a711-77ecbf28dc21" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.545811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fea2e72b-e28b-4734-a711-77ecbf28dc21" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.546341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fea2e72b-e28b-4734-a711-77ecbf28dc21" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.546432] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fea2e72b-e28b-4734-a711-77ecbf28dc21',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.547955] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c8a24d0e-87af-4465-ae43-ca9c589fc6b0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.684915] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: SUCCESS [ 621.685214] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.685214] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.686301] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.686301] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.857086] env[66519]: INFO networking_nsxv3.common.synchronization [req-33c99f1b-c329-4207-b01e-b5cf2e63bdf9 req-777bf0cf-cea3-4d8c-9626-e61889cdffce tempest-ServersAdminNegativeTestJSON-1811417065 tempest-ServersAdminNegativeTestJSON-1811417065-project-member] Enqueued Resource ID: 820ceacd-99d3-4034-aaf8-315de338869a with Priority: HIGHEST for action security_group_members [ 621.857525] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820ceacd-99d3-4034-aaf8-315de338869a with Priority: HIGHEST for action security_group_members [ 621.857924] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-820ceacd-99d3-4034-aaf8-315de338869a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.858102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.858195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.858484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.859312] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.859312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.859312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.859312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.859312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.859312] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.050659] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fea2e72b-e28b-4734-a711-77ecbf28dc21 [ 622.051021] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.051313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.051366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.051875] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.051875] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.051984] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fea2e72b-e28b-4734-a711-77ecbf28dc21 already deleted. [ 622.052050] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fea2e72b-e28b-4734-a711-77ecbf28dc21" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.052880] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.052880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.052880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.053179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.054108] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.054108] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 is going to be created. [ 622.085380] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.089377] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.089538] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.089929] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.090218] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.104334] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 in Status: UNINITIALIZED for 2s [ 622.188613] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.189381] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.275889] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.278228] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.278228] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.278228] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.278228] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.278228] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.278228] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.278228] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.278228] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.278228] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.278228] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 622.278228] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 622.278228] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 622.278228] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.278228] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 622.278228] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 622.322695] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 622.322907] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 622.323053] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 622.323222] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.323546] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-f1ed60b2-0ede-4af5-9f96-b8c912ea6955 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.323716] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-f1ed60b2-0ede-4af5-9f96-b8c912ea6955" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.323854] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-f1ed60b2-0ede-4af5-9f96-b8c912ea6955" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.324213] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-f1ed60b2-0ede-4af5-9f96-b8c912ea6955" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.324948] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1ed60b2-0ede-4af5-9f96-b8c912ea6955',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.365079] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.365079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.365079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.365400] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.365457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.366027] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.366027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.366027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.366274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.366473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.366473] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 820ceacd-99d3-4034-aaf8-315de338869a already deleted. [ 622.366662] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.624861] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: SUCCESS [ 622.625087] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.625256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.625474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.625721] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.625843] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.625908] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.626088] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.626159] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.626245] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.626341] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.827866] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.828314] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.828378] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.829265] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.829265] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.829265] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port f1ed60b2-0ede-4af5-9f96-b8c912ea6955 not found, creating... [ 622.829518] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.830121] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.830121] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.830121] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.830301] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.831052] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.831052] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.831315] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.831952] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.831952] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.832096] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: f1ed60b2-0ede-4af5-9f96-b8c912ea6955 is going to be created. [ 622.854781] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.855112] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.855282] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.855616] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.855909] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.856938] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-f1ed60b2-0ede-4af5-9f96-b8c912ea6955" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.112751] env[66519]: INFO networking_nsxv3.common.synchronization [req-9c0a45c5-311c-4b1b-a1f4-3ef6dd65d794 req-2178d700-10a3-46c8-aaf3-d9df6d8446fb tempest-SecurityGroupRulesTestJSON-2035222242 tempest-SecurityGroupRulesTestJSON-2035222242-project-member] Enqueued Resource ID: c0f978c5-efc2-4b8d-af0a-9af341db05cb with Priority: HIGHEST for action security_group_rules [ 623.112751] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0f978c5-efc2-4b8d-af0a-9af341db05cb with Priority: HIGHEST for action security_group_rules [ 623.112751] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0f978c5-efc2-4b8d-af0a-9af341db05cb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.112751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0f978c5-efc2-4b8d-af0a-9af341db05cb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.112751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0f978c5-efc2-4b8d-af0a-9af341db05cb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.112968] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0f978c5-efc2-4b8d-af0a-9af341db05cb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.112968] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0f978c5-efc2-4b8d-af0a-9af341db05cb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.128807] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.128991] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.129091] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.129308] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.129477] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.129599] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.129664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.129964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.130054] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.130160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.130320] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.130416] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.130472] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.130613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.130755] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.130845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.131156] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.131156] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.131272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.131315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.131424] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.387902] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cb7c090-e083-487a-aa5d-420200af9bce in Status: SUCCESS [ 623.387902] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.606169] env[66519]: INFO networking_nsxv3.common.synchronization [req-33c99f1b-c329-4207-b01e-b5cf2e63bdf9 req-6bd0fb58-bdd9-4f6b-b9d7-d1455bc8a164 service nova] Enqueued Resource ID: 820ceacd-99d3-4034-aaf8-315de338869a with Priority: HIGHEST for action security_group_rules [ 623.606169] env[66519]: INFO networking_nsxv3.common.synchronization [req-33c99f1b-c329-4207-b01e-b5cf2e63bdf9 req-6bd0fb58-bdd9-4f6b-b9d7-d1455bc8a164 service nova] Enqueued Resource ID: 820ceacd-99d3-4034-aaf8-315de338869a with Priority: HIGHEST for action security_group_members [ 623.606169] env[66519]: INFO networking_nsxv3.common.synchronization [req-33c99f1b-c329-4207-b01e-b5cf2e63bdf9 req-6bd0fb58-bdd9-4f6b-b9d7-d1455bc8a164 service nova] Enqueued Resource ID: f1ed60b2-0ede-4af5-9f96-b8c912ea6955 with Priority: HIGHEST for action port [ 623.606169] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820ceacd-99d3-4034-aaf8-315de338869a with Priority: HIGHEST for action security_group_rules [ 623.606349] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820ceacd-99d3-4034-aaf8-315de338869a with Priority: HIGHEST for action security_group_members [ 623.606349] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1ed60b2-0ede-4af5-9f96-b8c912ea6955 with Priority: HIGHEST for action port [ 623.607024] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-820ceacd-99d3-4034-aaf8-315de338869a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.607024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.607024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.607024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.607421] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.610511] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-820ceacd-99d3-4034-aaf8-315de338869a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.610680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.610754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.610957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.611143] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.611246] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.611311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.611498] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.611707] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.611707] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.612611] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1ed60b2-0ede-4af5-9f96-b8c912ea6955 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.612720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1ed60b2-0ede-4af5-9f96-b8c912ea6955" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.612780] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1ed60b2-0ede-4af5-9f96-b8c912ea6955" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.612943] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1ed60b2-0ede-4af5-9f96-b8c912ea6955" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.613450] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1ed60b2-0ede-4af5-9f96-b8c912ea6955',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.634301] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 376a7ea3-3e4d-4872-be2f-8bc029c25fac: rpc.has_security_group_logging(os_id): False [ 623.636200] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.636367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.636437] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.636668] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.636794] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.636927] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0f978c5-efc2-4b8d-af0a-9af341db05cb already deleted. [ 623.637528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0f978c5-efc2-4b8d-af0a-9af341db05cb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.659684] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.659827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.659889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.660116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.660209] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.660417] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.660511] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.660746] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.661755] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.661863] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.662096] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.662206] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.662274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.662448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.662558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.662794] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.662904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.662978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.663183] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.663307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.663408] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac is going to be updated. [ 623.745900] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.746063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.746063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.746295] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.746501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.780521] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: IN_PROGRESS for 2s [ 624.115465] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-820ceacd-99d3-4034-aaf8-315de338869a taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.115780] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.116593] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 in Status: SUCCESS [ 624.117044] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.117044] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.118922] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1ed60b2-0ede-4af5-9f96-b8c912ea6955 with status ACTIVE [ 624.120152] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.120303] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.120681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.120681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.120681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.120949] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.120949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.121051] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.121210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.121260] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.121722] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.121722] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.121722] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.121722] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.121890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.121890] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1ed60b2-0ede-4af5-9f96-b8c912ea6955 is going to be updated. [ 624.122879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.123048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.123202] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.123295] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.123355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.123491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.123562] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.123638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.123719] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c8a24d0e-87af-4465-ae43-ca9c589fc6b0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.147916] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.148090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.148286] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.148371] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.148505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.148666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1ed60b2-0ede-4af5-9f96-b8c912ea6955" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.619379] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.630497] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c8a24d0e-87af-4465-ae43-ca9c589fc6b0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.854043] env[66519]: INFO networking_nsxv3.common.synchronization [None req-67e9ffb5-ea65-41a4-9f1c-1e5b9bff61b3 None None] Enqueued Resource ID: cb2faeb3-b3c9-4b71-8659-b254ddbce837 with Priority: HIGHEST for action port [ 624.855741] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb2faeb3-b3c9-4b71-8659-b254ddbce837 with Priority: HIGHEST for action port [ 624.856260] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb2faeb3-b3c9-4b71-8659-b254ddbce837 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.856408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb2faeb3-b3c9-4b71-8659-b254ddbce837" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.856460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb2faeb3-b3c9-4b71-8659-b254ddbce837" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.857014] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb2faeb3-b3c9-4b71-8659-b254ddbce837" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.857099] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb2faeb3-b3c9-4b71-8659-b254ddbce837',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.931095] env[66519]: INFO networking_nsxv3.common.synchronization [req-8fa98748-3436-47b1-b463-9152aa47ff86 req-741df27d-e8ec-4e45-adc5-c5c1e527ae2f tempest-ServersWithSpecificFlavorTestJSON-1863263519 tempest-ServersWithSpecificFlavorTestJSON-1863263519-project-member] Enqueued Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_members [ 624.933769] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_members [ 624.935843] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-393aa0d3-c462-4737-b799-041054ed8323 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.936069] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.936470] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.936589] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.936755] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.937056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.937056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.937241] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.937402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.937476] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393aa0d3-c462-4737-b799-041054ed8323',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.122752] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.123190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.123190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.123321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.123554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.123616] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 820ceacd-99d3-4034-aaf8-315de338869a is going to be created. [ 625.133791] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c8a24d0e-87af-4465-ae43-ca9c589fc6b0: rpc.has_security_group_logging(os_id): False [ 625.155296] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.155470] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.155597] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.155788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.155995] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.158086] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.158207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.158262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.158480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.158580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.158868] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.159019] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.159420] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.159601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.159704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.159949] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 is going to be created. [ 625.174049] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820ceacd-99d3-4034-aaf8-315de338869a in Status: UNINITIALIZED for 2s [ 625.232084] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.232084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.232084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.232084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.232592] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.247341] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 in Status: IN_PROGRESS for 2s [ 625.361572] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb2faeb3-b3c9-4b71-8659-b254ddbce837 [ 625.361813] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.361958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.362039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.362266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.362394] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.362495] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb2faeb3-b3c9-4b71-8659-b254ddbce837 already deleted. [ 625.362533] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb2faeb3-b3c9-4b71-8659-b254ddbce837" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.404542] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-948 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.404542] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-948" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.404542] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-948" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.404876] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-948" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.405207] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.405395] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.405532] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.406135] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.406135] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.407312] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.407429] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.407545] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.407659] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.407778] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.407877] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.408075] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.435128] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.435293] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 625.435423] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.435597] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-948" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.435927] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-ed408aca-acc9-48bd-a765-82574596ffe5 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.436131] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-ed408aca-acc9-48bd-a765-82574596ffe5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.436249] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-ed408aca-acc9-48bd-a765-82574596ffe5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.436571] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-ed408aca-acc9-48bd-a765-82574596ffe5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.436700] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed408aca-acc9-48bd-a765-82574596ffe5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.439797] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.439797] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.439969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.440093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.440183] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.440380] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.440476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.444558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.444558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.444558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.444558] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393aa0d3-c462-4737-b799-041054ed8323 already deleted. [ 625.444558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.794792] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: SUCCESS [ 625.795032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.795212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.795443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.795551] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.939822] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.940271] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.940495] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.941193] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.941543] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.941884] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port ed408aca-acc9-48bd-a765-82574596ffe5 not found, creating... [ 625.942415] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.942690] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.942941] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.943411] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.943767] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.944330] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.944625] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.944816] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.945076] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.945239] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.945513] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: ed408aca-acc9-48bd-a765-82574596ffe5 is going to be created. [ 625.967288] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.967530] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.967631] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.967974] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.968299] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.968592] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-ed408aca-acc9-48bd-a765-82574596ffe5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.298048] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.298048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.298474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.298474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.298546] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.298647] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.298714] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.299135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.299135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.299135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.299289] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.718207] env[66519]: INFO networking_nsxv3.common.synchronization [req-8fa98748-3436-47b1-b463-9152aa47ff86 req-61acca4e-558a-4557-8614-fed99d420161 service nova] Enqueued Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_rules [ 626.718457] env[66519]: INFO networking_nsxv3.common.synchronization [req-8fa98748-3436-47b1-b463-9152aa47ff86 req-61acca4e-558a-4557-8614-fed99d420161 service nova] Enqueued Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_members [ 626.718656] env[66519]: INFO networking_nsxv3.common.synchronization [req-8fa98748-3436-47b1-b463-9152aa47ff86 req-61acca4e-558a-4557-8614-fed99d420161 service nova] Enqueued Resource ID: ed408aca-acc9-48bd-a765-82574596ffe5 with Priority: HIGHEST for action port [ 626.719409] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_rules [ 626.719520] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_members [ 626.719670] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed408aca-acc9-48bd-a765-82574596ffe5 with Priority: HIGHEST for action port [ 626.720058] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-393aa0d3-c462-4737-b799-041054ed8323 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.720227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.720326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.720608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.720725] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('393aa0d3-c462-4737-b799-041054ed8323',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.722376] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-393aa0d3-c462-4737-b799-041054ed8323 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.722540] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.722638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.722900] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.723169] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.723263] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.723371] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.723585] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.723711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.723843] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393aa0d3-c462-4737-b799-041054ed8323',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.728189] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed408aca-acc9-48bd-a765-82574596ffe5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.728189] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed408aca-acc9-48bd-a765-82574596ffe5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.728189] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed408aca-acc9-48bd-a765-82574596ffe5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.728395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed408aca-acc9-48bd-a765-82574596ffe5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.728395] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed408aca-acc9-48bd-a765-82574596ffe5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.801217] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.801455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.801519] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.801956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.802087] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.802165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.802216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.802434] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.802549] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.802669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.802879] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.803046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.803402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.803402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.803522] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.803522] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.803681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.803771] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.803865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.803995] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.804222] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.954135] env[66519]: INFO networking_nsxv3.common.synchronization [req-26b27012-5510-472d-b355-5315ae628fa7 req-f1afb93d-d3d7-40d3-ae3f-04e4d832983a tempest-ServerExternalEventsTest-1641976964 tempest-ServerExternalEventsTest-1641976964-project-member] Enqueued Resource ID: 91966b7c-171f-4c65-8a17-9eb277064959 with Priority: HIGHEST for action security_group_members [ 626.954924] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91966b7c-171f-4c65-8a17-9eb277064959 with Priority: HIGHEST for action security_group_members [ 626.955434] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-91966b7c-171f-4c65-8a17-9eb277064959 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.955574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.955650] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.955958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.956207] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.956324] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.956389] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.956582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.956687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.956784] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('91966b7c-171f-4c65-8a17-9eb277064959',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.193698] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820ceacd-99d3-4034-aaf8-315de338869a in Status: SUCCESS [ 627.193698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.193698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.193698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.193698] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.193698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.193698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.193698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.193698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.193698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.193698] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.224102] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-393aa0d3-c462-4737-b799-041054ed8323 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.227113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.231491] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('393aa0d3-c462-4737-b799-041054ed8323',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.233038] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed408aca-acc9-48bd-a765-82574596ffe5 with status ACTIVE [ 627.233038] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.233332] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.233332] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.233562] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.233685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.233968] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.234100] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.234163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.234375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.234485] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.234972] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.234972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.234972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.235218] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.235218] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.235303] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed408aca-acc9-48bd-a765-82574596ffe5 is going to be updated. [ 627.261905] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 in Status: SUCCESS [ 627.262039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.276438] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.276636] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.276636] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.276980] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.277186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.277277] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed408aca-acc9-48bd-a765-82574596ffe5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.306236] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 376a7ea3-3e4d-4872-be2f-8bc029c25fac: rpc.has_security_group_logging(os_id): False [ 627.329159] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.329159] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.329159] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.329159] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.329432] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.329546] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.329592] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.329685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.329797] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.329874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.330087] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.330194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.330253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.330402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.330478] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.330672] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.330770] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.330821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.330963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.334760] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.334760] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac is going to be updated. [ 627.417627] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.417874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.417939] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.418154] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.418362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.438158] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: IN_PROGRESS for 2s [ 627.460500] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.460671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.460756] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.461009] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.461134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.461348] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.461455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.461528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.461734] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.461829] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.462326] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91966b7c-171f-4c65-8a17-9eb277064959 is going to be updated. [ 627.514034] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.514034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.514034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.514034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.514034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.530665] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91966b7c-171f-4c65-8a17-9eb277064959 in Status: IN_PROGRESS for 2s [ 627.698522] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-820ceacd-99d3-4034-aaf8-315de338869a taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.698677] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.698788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.700751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.700751] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.700751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.700751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.700751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.700751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.700751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.700751] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-820ceacd-99d3-4034-aaf8-315de338869a taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.700751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.700751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.700751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.700751] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.700751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.700751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.700751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.701831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.701831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.701831] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.726704] env[66519]: INFO networking_nsxv3.common.synchronization [None req-9a4a6bc4-2844-4f15-a257-5c57a64b2522 None None] Enqueued Resource ID: 3012e84a-c372-4357-ac0e-be6b4b166993 with Priority: HIGHEST for action port [ 627.728873] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3012e84a-c372-4357-ac0e-be6b4b166993 with Priority: HIGHEST for action port [ 627.728873] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-3012e84a-c372-4357-ac0e-be6b4b166993 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.728873] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3012e84a-c372-4357-ac0e-be6b4b166993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.728873] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3012e84a-c372-4357-ac0e-be6b4b166993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.728873] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3012e84a-c372-4357-ac0e-be6b4b166993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.728873] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3012e84a-c372-4357-ac0e-be6b4b166993',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.734908] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('393aa0d3-c462-4737-b799-041054ed8323',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.207966] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 820ceacd-99d3-4034-aaf8-315de338869a: rpc.has_security_group_logging(os_id): False [ 628.227145] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.227296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.228317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.228317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.228317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.228317] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.228317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.228317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.228317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.228317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.228886] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.228886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.228886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.228886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.228886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.229067] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.230357] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.230515] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.230708] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.230822] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.230999] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 820ceacd-99d3-4034-aaf8-315de338869a is going to be created. [ 628.234240] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3012e84a-c372-4357-ac0e-be6b4b166993 [ 628.234240] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.234240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.234240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.234660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.234660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.234660] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3012e84a-c372-4357-ac0e-be6b4b166993 already deleted. [ 628.235041] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3012e84a-c372-4357-ac0e-be6b4b166993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.237067] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.237229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.237353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.237507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.237592] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.237674] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393aa0d3-c462-4737-b799-041054ed8323 is going to be created. [ 628.268166] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.269645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.269645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.269645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.269645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.283358] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393aa0d3-c462-4737-b799-041054ed8323 in Status: UNINITIALIZED for 2s [ 628.323228] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.323591] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.323591] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.324428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.324428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.338126] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 820ceacd-99d3-4034-aaf8-315de338869a in Status: IN_PROGRESS for 2s [ 629.455890] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: SUCCESS [ 629.455890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.545608] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 91966b7c-171f-4c65-8a17-9eb277064959 in Status: SUCCESS [ 629.546802] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 91966b7c-171f-4c65-8a17-9eb277064959 deletion is rescheduled due to dependency. [ 629.548214] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.294699] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393aa0d3-c462-4737-b799-041054ed8323 in Status: SUCCESS [ 630.294927] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.296532] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.296532] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.297214] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.297366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.297435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.297694] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.297732] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.297842] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.297941] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('393aa0d3-c462-4737-b799-041054ed8323',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.321676] env[66519]: INFO networking_nsxv3.common.synchronization [None req-67320ec2-459c-4863-8fc7-1c6b277ddb37 None None] Enqueued Resource ID: f45486f9-33c6-420d-a649-04cdebdca119 with Priority: HIGHEST for action port [ 630.324704] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f45486f9-33c6-420d-a649-04cdebdca119 with Priority: HIGHEST for action port [ 630.324704] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-f45486f9-33c6-420d-a649-04cdebdca119 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.324704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f45486f9-33c6-420d-a649-04cdebdca119" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.324704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f45486f9-33c6-420d-a649-04cdebdca119" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.324704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f45486f9-33c6-420d-a649-04cdebdca119" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.324704] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f45486f9-33c6-420d-a649-04cdebdca119',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.363218] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 820ceacd-99d3-4034-aaf8-315de338869a in Status: SUCCESS [ 630.363503] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.802093] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('393aa0d3-c462-4737-b799-041054ed8323',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.828254] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f45486f9-33c6-420d-a649-04cdebdca119 [ 630.828524] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.828623] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.828660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.828912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.828981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.829110] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f45486f9-33c6-420d-a649-04cdebdca119 already deleted. [ 630.829170] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f45486f9-33c6-420d-a649-04cdebdca119" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.964779] env[66519]: INFO networking_nsxv3.common.synchronization [req-6189d06a-e0cb-42c8-a301-0426c6cfaa4c req-39dc937d-b083-40dc-aa25-d1f683bdeff5 tempest-ListImageFiltersTestJSON-725451738 tempest-ListImageFiltersTestJSON-725451738-project-member] Enqueued Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGHEST for action security_group_members [ 630.965802] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGHEST for action security_group_members [ 630.965802] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.965802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.966103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.966158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.966287] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.966382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.966438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.966584] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.966659] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.966751] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.304914] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 393aa0d3-c462-4737-b799-041054ed8323: rpc.has_security_group_logging(os_id): False [ 631.327273] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.327445] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.327500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.327761] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.327860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.328118] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.328227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.328294] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.328458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.328534] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.328673] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 393aa0d3-c462-4737-b799-041054ed8323 is going to be created. [ 631.393327] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.394921] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.395089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.395603] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.395923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.409543] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393aa0d3-c462-4737-b799-041054ed8323 in Status: IN_PROGRESS for 2s [ 631.469354] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.469599] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.469599] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.469903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.470048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.470319] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.470441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.470531] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.470949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.470949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.471103] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce52e424-4971-4af0-bb7e-19455530de2e already deleted. [ 631.471225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.548908] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.549146] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.549246] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.549527] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.549789] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.551622] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.551622] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.551622] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.551622] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.551622] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.551622] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 631.551622] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 631.551622] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 631.551622] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.551622] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 631.551622] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 631.570563] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 631.570811] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 631.570956] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 631.571148] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.571461] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-3121003f-aea2-4545-900d-326ca4ddf89c taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.571621] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-3121003f-aea2-4545-900d-326ca4ddf89c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.571733] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-3121003f-aea2-4545-900d-326ca4ddf89c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.572085] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-3121003f-aea2-4545-900d-326ca4ddf89c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.572228] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3121003f-aea2-4545-900d-326ca4ddf89c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.077242] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.077242] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.077242] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.077242] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.077242] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.077242] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 3121003f-aea2-4545-900d-326ca4ddf89c not found, creating... [ 632.077242] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.077242] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.077242] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.078931] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.078931] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.081792] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.081792] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.081792] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.081792] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.081792] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.081792] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 3121003f-aea2-4545-900d-326ca4ddf89c is going to be created. [ 632.104946] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.107026] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.107026] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.107026] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.107026] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.107026] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-3121003f-aea2-4545-900d-326ca4ddf89c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.667743] env[66519]: INFO networking_nsxv3.common.synchronization [None req-4c9ec0ad-684a-430c-a93b-9637f6fd6d32 None None] Enqueued Resource ID: ed1943bf-df67-4793-95ab-2445977912fd with Priority: HIGHEST for action port [ 632.668317] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed1943bf-df67-4793-95ab-2445977912fd with Priority: HIGHEST for action port [ 632.668622] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed1943bf-df67-4793-95ab-2445977912fd taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.668748] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed1943bf-df67-4793-95ab-2445977912fd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.668808] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed1943bf-df67-4793-95ab-2445977912fd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.669143] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed1943bf-df67-4793-95ab-2445977912fd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.669424] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed1943bf-df67-4793-95ab-2445977912fd',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.801952] env[66519]: INFO networking_nsxv3.common.synchronization [req-6189d06a-e0cb-42c8-a301-0426c6cfaa4c req-c505a281-8207-4209-a520-de490fe83c3a service nova] Enqueued Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGHEST for action security_group_rules [ 632.802089] env[66519]: INFO networking_nsxv3.common.synchronization [req-6189d06a-e0cb-42c8-a301-0426c6cfaa4c req-c505a281-8207-4209-a520-de490fe83c3a service nova] Enqueued Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGHEST for action security_group_members [ 632.802460] env[66519]: INFO networking_nsxv3.common.synchronization [req-6189d06a-e0cb-42c8-a301-0426c6cfaa4c req-c505a281-8207-4209-a520-de490fe83c3a service nova] Enqueued Resource ID: 3121003f-aea2-4545-900d-326ca4ddf89c with Priority: HIGHEST for action port [ 632.802782] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGHEST for action security_group_rules [ 632.802927] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGHEST for action security_group_members [ 632.803375] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3121003f-aea2-4545-900d-326ca4ddf89c with Priority: HIGHEST for action port [ 632.803516] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.803729] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.803729] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.804108] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.804237] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.805671] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.806013] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.806013] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.806201] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.806388] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.806517] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.806619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.806791] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.806913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.807042] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.807873] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-3121003f-aea2-4545-900d-326ca4ddf89c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.808038] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3121003f-aea2-4545-900d-326ca4ddf89c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.808128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3121003f-aea2-4545-900d-326ca4ddf89c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.808989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3121003f-aea2-4545-900d-326ca4ddf89c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.808989] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3121003f-aea2-4545-900d-326ca4ddf89c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.172973] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed1943bf-df67-4793-95ab-2445977912fd [ 633.173368] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.173368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.173471] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.173651] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.173741] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.173842] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed1943bf-df67-4793-95ab-2445977912fd already deleted. [ 633.173923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed1943bf-df67-4793-95ab-2445977912fd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.310421] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.311813] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.311813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.312017] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3121003f-aea2-4545-900d-326ca4ddf89c with status ACTIVE [ 633.312205] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.312318] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.312383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.312583] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.312671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.312841] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.312936] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.312997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.313404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.313404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.313404] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.313546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.313546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.314992] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.315129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.315308] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3121003f-aea2-4545-900d-326ca4ddf89c is going to be updated. [ 633.338990] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.338990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.338990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.339352] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.339352] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.339421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3121003f-aea2-4545-900d-326ca4ddf89c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.432021] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393aa0d3-c462-4737-b799-041054ed8323 in Status: SUCCESS [ 633.432021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.641515] env[66519]: INFO networking_nsxv3.common.synchronization [None req-180fefcb-3d38-4560-b440-906887f60943 None None] Enqueued Resource ID: a8c374d5-4ac6-4bf3-a652-cbc6b4f369ad with Priority: HIGHEST for action port [ 633.642096] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8c374d5-4ac6-4bf3-a652-cbc6b4f369ad with Priority: HIGHEST for action port [ 633.642445] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8c374d5-4ac6-4bf3-a652-cbc6b4f369ad taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.642693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8c374d5-4ac6-4bf3-a652-cbc6b4f369ad" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.642693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8c374d5-4ac6-4bf3-a652-cbc6b4f369ad" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.642974] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8c374d5-4ac6-4bf3-a652-cbc6b4f369ad" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.643079] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8c374d5-4ac6-4bf3-a652-cbc6b4f369ad',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.812892] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.146181] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a8c374d5-4ac6-4bf3-a652-cbc6b4f369ad [ 634.148921] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.149274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.149274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.149443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.149528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.149630] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a8c374d5-4ac6-4bf3-a652-cbc6b4f369ad already deleted. [ 634.149738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8c374d5-4ac6-4bf3-a652-cbc6b4f369ad" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.318189] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.318189] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.318189] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.318189] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.318189] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.318189] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce52e424-4971-4af0-bb7e-19455530de2e is going to be created. [ 634.350244] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.350455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.350455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.350710] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.350830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.365327] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce52e424-4971-4af0-bb7e-19455530de2e in Status: UNINITIALIZED for 2s [ 634.554717] env[66519]: INFO networking_nsxv3.common.synchronization [None req-b1ada61d-d4ed-488e-96a9-43fde8df5d88 None None] Enqueued Resource ID: 95605a18-13e9-47dc-a4f5-9ab961d3671c with Priority: HIGHEST for action port [ 634.555355] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95605a18-13e9-47dc-a4f5-9ab961d3671c with Priority: HIGHEST for action port [ 634.555706] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-95605a18-13e9-47dc-a4f5-9ab961d3671c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.555869] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95605a18-13e9-47dc-a4f5-9ab961d3671c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.555935] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95605a18-13e9-47dc-a4f5-9ab961d3671c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.557423] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95605a18-13e9-47dc-a4f5-9ab961d3671c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.557423] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95605a18-13e9-47dc-a4f5-9ab961d3671c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.032812] env[66519]: INFO networking_nsxv3.common.synchronization [req-3ea44eab-9e47-4da7-8b10-f19b1f86eeef req-9a33b3f5-013d-4916-8f31-7ce5f842ae7f tempest-SecurityGroupRulesTestJSON-2035222242 tempest-SecurityGroupRulesTestJSON-2035222242-project-member] Enqueued Resource ID: c4c3052b-ee8a-4014-89fe-9a66ee753792 with Priority: HIGHEST for action security_group_rules [ 635.033356] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4c3052b-ee8a-4014-89fe-9a66ee753792 with Priority: HIGHEST for action security_group_rules [ 635.034957] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4c3052b-ee8a-4014-89fe-9a66ee753792 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.035091] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4c3052b-ee8a-4014-89fe-9a66ee753792" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.035192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4c3052b-ee8a-4014-89fe-9a66ee753792" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.035506] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4c3052b-ee8a-4014-89fe-9a66ee753792" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.035581] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4c3052b-ee8a-4014-89fe-9a66ee753792',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.066923] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 95605a18-13e9-47dc-a4f5-9ab961d3671c [ 635.067281] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.067421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.067505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.067807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.067928] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.068065] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:95605a18-13e9-47dc-a4f5-9ab961d3671c already deleted. [ 635.068170] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95605a18-13e9-47dc-a4f5-9ab961d3671c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.563718] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.563718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.563718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.563718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.563718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.564708] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4c3052b-ee8a-4014-89fe-9a66ee753792 already deleted. [ 635.564708] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4c3052b-ee8a-4014-89fe-9a66ee753792" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.379816] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce52e424-4971-4af0-bb7e-19455530de2e in Status: SUCCESS [ 636.379942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.380120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.380378] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.380522] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.380634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.380705] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.381515] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.381515] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.381515] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.381515] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.596599] env[66519]: INFO networking_nsxv3.common.synchronization [None req-74986c0d-11ac-43ba-a446-628a40e737e5 None None] Enqueued Resource ID: 4a7273f7-8699-4a07-8afe-7829d7a3de28 with Priority: HIGHEST for action port [ 636.596823] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a7273f7-8699-4a07-8afe-7829d7a3de28 with Priority: HIGHEST for action port [ 636.597116] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a7273f7-8699-4a07-8afe-7829d7a3de28 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.597234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a7273f7-8699-4a07-8afe-7829d7a3de28" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.597309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a7273f7-8699-4a07-8afe-7829d7a3de28" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.598059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a7273f7-8699-4a07-8afe-7829d7a3de28" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.598059] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a7273f7-8699-4a07-8afe-7829d7a3de28',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.884633] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.884900] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.885017] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.885225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.885400] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.885510] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.885584] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.885827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.885987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.886102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.886267] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.886363] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.886434] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.887229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.887229] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.887229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.887229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.887229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.887229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.887229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.887701] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.100439] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a7273f7-8699-4a07-8afe-7829d7a3de28 [ 637.101031] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.101238] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.101340] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.101577] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.101813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.101964] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a7273f7-8699-4a07-8afe-7829d7a3de28 already deleted. [ 637.102495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a7273f7-8699-4a07-8afe-7829d7a3de28" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.350444] env[66519]: INFO networking_nsxv3.common.synchronization [None req-857787eb-2205-4a6d-bbc5-3e37d7ec840e None None] Enqueued Resource ID: 6ff1e497-bb3f-484a-895c-b7d02ec035e1 with Priority: HIGHEST for action port [ 637.352669] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ff1e497-bb3f-484a-895c-b7d02ec035e1 with Priority: HIGHEST for action port [ 637.352669] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ff1e497-bb3f-484a-895c-b7d02ec035e1 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.352669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ff1e497-bb3f-484a-895c-b7d02ec035e1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.352669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ff1e497-bb3f-484a-895c-b7d02ec035e1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.352669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ff1e497-bb3f-484a-895c-b7d02ec035e1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.352669] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ff1e497-bb3f-484a-895c-b7d02ec035e1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.390409] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce52e424-4971-4af0-bb7e-19455530de2e: rpc.has_security_group_logging(os_id): False [ 637.411878] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.412386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.412496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.412724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.412825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.413037] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.413153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.413223] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.414086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.414086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.414086] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.414086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.414086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.414086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.414086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.414505] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.414787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.414787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.415063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.415189] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.415451] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce52e424-4971-4af0-bb7e-19455530de2e is going to be created. [ 637.483957] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.484169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.484372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.484412] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.484604] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.504992] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce52e424-4971-4af0-bb7e-19455530de2e in Status: IN_PROGRESS for 2s [ 637.854871] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ff1e497-bb3f-484a-895c-b7d02ec035e1 [ 637.855211] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.855279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.855316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.855543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.855640] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.855787] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ff1e497-bb3f-484a-895c-b7d02ec035e1 already deleted. [ 637.855868] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ff1e497-bb3f-484a-895c-b7d02ec035e1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.355150] env[66519]: INFO networking_nsxv3.common.synchronization [req-df42679b-a50a-447d-bd46-86b2c4abb7ec req-b248ae65-1ef5-46dc-8dc6-c009c262006a tempest-ListImageFiltersTestJSON-725451738 tempest-ListImageFiltersTestJSON-725451738-project-member] Enqueued Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGHEST for action security_group_members [ 638.355150] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGHEST for action security_group_members [ 638.357950] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.357950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.357950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.357950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.357950] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.357950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.357950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.357950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.357950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.357950] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.728141] env[66519]: INFO networking_nsxv3.common.synchronization [None req-5aac2fa4-4e91-44e1-a180-e0900e363a2b None None] Enqueued Resource ID: 51bcf36d-c0a2-499d-a4ea-aab4d01f039e with Priority: HIGHEST for action port [ 638.728913] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51bcf36d-c0a2-499d-a4ea-aab4d01f039e with Priority: HIGHEST for action port [ 638.730411] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-51bcf36d-c0a2-499d-a4ea-aab4d01f039e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.730565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51bcf36d-c0a2-499d-a4ea-aab4d01f039e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.730643] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51bcf36d-c0a2-499d-a4ea-aab4d01f039e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.730910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51bcf36d-c0a2-499d-a4ea-aab4d01f039e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.731021] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51bcf36d-c0a2-499d-a4ea-aab4d01f039e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.860480] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.878688] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.879121] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.879486] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.880020] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.880847] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.881184] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.881498] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.882065] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.882128] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.882412] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.882908] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.882908] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.882908] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.883144] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.883286] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.883477] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.906952] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.907289] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 638.907624] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.907727] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.908458] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-ad971db0-1166-435c-baec-fb282fdca8b2 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.908458] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-ad971db0-1166-435c-baec-fb282fdca8b2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.908458] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-ad971db0-1166-435c-baec-fb282fdca8b2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.908802] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-ad971db0-1166-435c-baec-fb282fdca8b2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.908945] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad971db0-1166-435c-baec-fb282fdca8b2',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.139295] env[66519]: INFO networking_nsxv3.common.synchronization [None req-54fcd846-8509-41c1-bc34-c0af41a07f0e None None] Enqueued Resource ID: 508f4aea-9cb6-46e9-b1aa-982bed3c6dc1 with Priority: HIGHEST for action port [ 639.139956] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 508f4aea-9cb6-46e9-b1aa-982bed3c6dc1 with Priority: HIGHEST for action port [ 639.141633] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-508f4aea-9cb6-46e9-b1aa-982bed3c6dc1 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.141633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-508f4aea-9cb6-46e9-b1aa-982bed3c6dc1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.141633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-508f4aea-9cb6-46e9-b1aa-982bed3c6dc1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.141633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-508f4aea-9cb6-46e9-b1aa-982bed3c6dc1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.141633] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('508f4aea-9cb6-46e9-b1aa-982bed3c6dc1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.233384] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51bcf36d-c0a2-499d-a4ea-aab4d01f039e [ 639.233870] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.233870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.236810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.237030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.237740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.237740] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51bcf36d-c0a2-499d-a4ea-aab4d01f039e already deleted. [ 639.237740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51bcf36d-c0a2-499d-a4ea-aab4d01f039e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.363156] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.413365] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.413872] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.414086] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.415189] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.415189] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.415189] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port ad971db0-1166-435c-baec-fb282fdca8b2 not found, creating... [ 639.415376] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.415523] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.416060] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.416350] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.416496] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.416793] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.416956] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.417092] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.417318] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.417891] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.418093] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: ad971db0-1166-435c-baec-fb282fdca8b2 is going to be created. [ 639.453313] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.453313] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.453313] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.453313] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.453313] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.453313] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-ad971db0-1166-435c-baec-fb282fdca8b2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.521057] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce52e424-4971-4af0-bb7e-19455530de2e in Status: SUCCESS [ 639.521484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.645696] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 508f4aea-9cb6-46e9-b1aa-982bed3c6dc1 [ 639.645696] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.645696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.645696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.646215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.646215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.646215] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:508f4aea-9cb6-46e9-b1aa-982bed3c6dc1 already deleted. [ 639.646376] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-508f4aea-9cb6-46e9-b1aa-982bed3c6dc1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.832731] env[66519]: INFO networking_nsxv3.common.synchronization [req-5f3fd2b6-0969-421b-87c6-3b1dff91e9a9 req-5ddfcebd-e2ba-42d2-b219-1f4df4e89fab tempest-DeleteServersAdminTestJSON-67108890 tempest-DeleteServersAdminTestJSON-67108890-project-member] Enqueued Resource ID: 6960f374-b898-4940-b626-d2d9b6819605 with Priority: HIGHEST for action security_group_members [ 639.833352] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6960f374-b898-4940-b626-d2d9b6819605 with Priority: HIGHEST for action security_group_members [ 639.833670] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6960f374-b898-4940-b626-d2d9b6819605 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.834042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.834042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.835918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.836140] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.836263] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.836339] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.836528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.836619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.836721] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6960f374-b898-4940-b626-d2d9b6819605',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.866543] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.866879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.866879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.867563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.867676] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.867800] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce52e424-4971-4af0-bb7e-19455530de2e is going to be updated. [ 639.899837] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.899837] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.899837] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.901015] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.901015] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.910305] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce52e424-4971-4af0-bb7e-19455530de2e in Status: IN_PROGRESS for 2s [ 640.207963] env[66519]: INFO networking_nsxv3.common.synchronization [req-df42679b-a50a-447d-bd46-86b2c4abb7ec req-2a8a9ec2-09e4-406f-9794-2813fc4f4a8e service nova] Enqueued Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGHEST for action security_group_rules [ 640.208190] env[66519]: INFO networking_nsxv3.common.synchronization [req-df42679b-a50a-447d-bd46-86b2c4abb7ec req-2a8a9ec2-09e4-406f-9794-2813fc4f4a8e service nova] Enqueued Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGHEST for action security_group_members [ 640.208282] env[66519]: INFO networking_nsxv3.common.synchronization [req-df42679b-a50a-447d-bd46-86b2c4abb7ec req-2a8a9ec2-09e4-406f-9794-2813fc4f4a8e service nova] Enqueued Resource ID: ad971db0-1166-435c-baec-fb282fdca8b2 with Priority: HIGHEST for action port [ 640.208808] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGHEST for action security_group_rules [ 640.208947] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGHEST for action security_group_members [ 640.209261] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad971db0-1166-435c-baec-fb282fdca8b2 with Priority: HIGHEST for action port [ 640.209405] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.209549] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.209615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.209854] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.209955] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.210842] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.210944] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.211715] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad971db0-1166-435c-baec-fb282fdca8b2 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.211715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad971db0-1166-435c-baec-fb282fdca8b2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.211715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad971db0-1166-435c-baec-fb282fdca8b2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.211715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad971db0-1166-435c-baec-fb282fdca8b2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.211715] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad971db0-1166-435c-baec-fb282fdca8b2',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.340852] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.341521] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.341521] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.341521] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.341794] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.341794] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.341945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.341945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.342155] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.342155] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.342257] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6960f374-b898-4940-b626-d2d9b6819605 is going to be updated. [ 640.386647] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.386784] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.386784] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.389026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.389026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.402120] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6960f374-b898-4940-b626-d2d9b6819605 in Status: IN_PROGRESS for 2s [ 640.641529] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.641733] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.642437] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.642437] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.642437] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.642637] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.642637] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.642818] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.642986] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.643208] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.643322] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.643420] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.644086] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.644086] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.644086] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.644086] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.666030] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.666030] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 640.666030] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.666220] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.667068] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-01db93af-1bad-4530-aa80-59ab3478a7f4 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.667068] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-01db93af-1bad-4530-aa80-59ab3478a7f4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.667068] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-01db93af-1bad-4530-aa80-59ab3478a7f4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.667301] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-01db93af-1bad-4530-aa80-59ab3478a7f4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.667301] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01db93af-1bad-4530-aa80-59ab3478a7f4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.713716] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.713716] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.713903] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad971db0-1166-435c-baec-fb282fdca8b2 with status ACTIVE [ 640.713941] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.714045] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.714113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.714318] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.714405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.714572] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.714665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.714820] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.715084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.715179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.715386] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.715492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.715554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.715770] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.715988] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.716104] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad971db0-1166-435c-baec-fb282fdca8b2 is going to be updated. [ 640.742043] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.742233] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.742278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.742456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.742676] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.742888] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad971db0-1166-435c-baec-fb282fdca8b2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.170160] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.170492] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.170492] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.171728] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.172065] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.175058] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 01db93af-1bad-4530-aa80-59ab3478a7f4 not found, creating... [ 641.175058] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.175058] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.175058] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.175058] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.175058] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.175058] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.175058] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.175058] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.175058] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.175593] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.175593] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 01db93af-1bad-4530-aa80-59ab3478a7f4 is going to be created. [ 641.197921] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.197921] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.199553] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.199553] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.199553] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.199553] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-01db93af-1bad-4530-aa80-59ab3478a7f4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.708044] env[66519]: INFO networking_nsxv3.common.synchronization [None req-82ab3bc5-2ea5-4f03-9597-60793209b473 None None] Enqueued Resource ID: bd92dc7e-40db-4ff4-9b15-b66e9c1ee44d with Priority: HIGHEST for action port [ 641.708044] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd92dc7e-40db-4ff4-9b15-b66e9c1ee44d with Priority: HIGHEST for action port [ 641.708234] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd92dc7e-40db-4ff4-9b15-b66e9c1ee44d taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.708422] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd92dc7e-40db-4ff4-9b15-b66e9c1ee44d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.708686] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd92dc7e-40db-4ff4-9b15-b66e9c1ee44d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.708824] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd92dc7e-40db-4ff4-9b15-b66e9c1ee44d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.708941] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd92dc7e-40db-4ff4-9b15-b66e9c1ee44d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.717255] env[66519]: INFO networking_nsxv3.common.synchronization [None req-b19bf7ab-dfda-4b01-9a9e-b412832200ed None None] Enqueued Resource ID: 0070dc1f-4dc5-4437-a74d-9c71d762abf2 with Priority: HIGHEST for action port [ 641.717495] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0070dc1f-4dc5-4437-a74d-9c71d762abf2 with Priority: HIGHEST for action port [ 641.719302] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-0070dc1f-4dc5-4437-a74d-9c71d762abf2 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.719302] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0070dc1f-4dc5-4437-a74d-9c71d762abf2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.719302] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0070dc1f-4dc5-4437-a74d-9c71d762abf2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.719302] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0070dc1f-4dc5-4437-a74d-9c71d762abf2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.719302] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0070dc1f-4dc5-4437-a74d-9c71d762abf2',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.899149] env[66519]: INFO networking_nsxv3.common.synchronization [req-5f3fd2b6-0969-421b-87c6-3b1dff91e9a9 req-cda0f3cf-e2d5-47b8-b25f-4e345ee454cb service nova] Enqueued Resource ID: 6960f374-b898-4940-b626-d2d9b6819605 with Priority: HIGHEST for action security_group_rules [ 641.899149] env[66519]: INFO networking_nsxv3.common.synchronization [req-5f3fd2b6-0969-421b-87c6-3b1dff91e9a9 req-cda0f3cf-e2d5-47b8-b25f-4e345ee454cb service nova] Enqueued Resource ID: 6960f374-b898-4940-b626-d2d9b6819605 with Priority: HIGHEST for action security_group_members [ 641.899285] env[66519]: INFO networking_nsxv3.common.synchronization [req-5f3fd2b6-0969-421b-87c6-3b1dff91e9a9 req-cda0f3cf-e2d5-47b8-b25f-4e345ee454cb service nova] Enqueued Resource ID: 01db93af-1bad-4530-aa80-59ab3478a7f4 with Priority: HIGHEST for action port [ 641.899793] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6960f374-b898-4940-b626-d2d9b6819605 with Priority: HIGHEST for action security_group_rules [ 641.899926] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6960f374-b898-4940-b626-d2d9b6819605 with Priority: HIGHEST for action security_group_members [ 641.900325] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01db93af-1bad-4530-aa80-59ab3478a7f4 with Priority: HIGHEST for action port [ 641.900673] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6960f374-b898-4940-b626-d2d9b6819605 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.900817] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.900869] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.901065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.901193] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6960f374-b898-4940-b626-d2d9b6819605',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.903773] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6960f374-b898-4940-b626-d2d9b6819605 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.903880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.904086] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-01db93af-1bad-4530-aa80-59ab3478a7f4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.904187] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01db93af-1bad-4530-aa80-59ab3478a7f4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.904269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01db93af-1bad-4530-aa80-59ab3478a7f4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.904455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01db93af-1bad-4530-aa80-59ab3478a7f4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.904535] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01db93af-1bad-4530-aa80-59ab3478a7f4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.922144] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce52e424-4971-4af0-bb7e-19455530de2e in Status: SUCCESS [ 641.922364] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.922835] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.923058] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.923256] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.923375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.923438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.923596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.923669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.924521] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.211137] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd92dc7e-40db-4ff4-9b15-b66e9c1ee44d [ 642.211382] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.211501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.211599] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.211822] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.211909] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.212044] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd92dc7e-40db-4ff4-9b15-b66e9c1ee44d already deleted. [ 642.212684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd92dc7e-40db-4ff4-9b15-b66e9c1ee44d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.222164] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0070dc1f-4dc5-4437-a74d-9c71d762abf2 [ 642.222392] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.222523] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.222595] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.222928] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.223013] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.223094] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0070dc1f-4dc5-4437-a74d-9c71d762abf2 already deleted. [ 642.223177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0070dc1f-4dc5-4437-a74d-9c71d762abf2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.407633] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6960f374-b898-4940-b626-d2d9b6819605 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.407875] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.408096] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01db93af-1bad-4530-aa80-59ab3478a7f4 with status ACTIVE [ 642.408356] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.408518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.408619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.408923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.409083] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.409343] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.409490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.409586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.410061] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.410061] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.410206] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.410357] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.410441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.410653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.410770] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.410897] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01db93af-1bad-4530-aa80-59ab3478a7f4 is going to be updated. [ 642.413674] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6960f374-b898-4940-b626-d2d9b6819605 in Status: SUCCESS [ 642.413902] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6960f374-b898-4940-b626-d2d9b6819605 deletion is rescheduled due to dependency. [ 642.418213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.418795] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.419053] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.419210] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.419324] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.419397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.419560] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.419631] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.419723] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6960f374-b898-4940-b626-d2d9b6819605',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.426213] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.433597] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.433952] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.434050] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.434258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.434496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.434672] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01db93af-1bad-4530-aa80-59ab3478a7f4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.922552] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6960f374-b898-4940-b626-d2d9b6819605',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.928685] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.101650] env[66519]: INFO networking_nsxv3.common.synchronization [req-95c93a13-dbc0-494b-8e72-ff23edd89449 req-4d344505-4cde-4366-a3fd-6985a646606b tempest-ServerRescueNegativeTestJSON-912870119 tempest-ServerRescueNegativeTestJSON-912870119-project-member] Enqueued Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGHEST for action security_group_members [ 643.102418] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGHEST for action security_group_members [ 643.103411] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.103411] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.103411] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.103690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.103851] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.103963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.104057] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.104187] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.104271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.104364] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.425309] env[66519]: INFO networking_nsxv3.common.synchronization [None req-9709d55a-c6b8-4414-86d4-072ff198286b tempest-ServerActionsV293TestJSON-1719924090 tempest-ServerActionsV293TestJSON-1719924090-project-member] Enqueued Resource ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a with Priority: HIGHEST for action security_group_rules [ 643.426215] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a with Priority: HIGHEST for action security_group_rules [ 643.426215] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.426215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.426215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.426428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.426428] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94ea0731-22a6-40ee-a699-ef5f6ebe0f3a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.427447] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6960f374-b898-4940-b626-d2d9b6819605',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.430660] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.431158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.431158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.431289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.431822] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.431937] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce52e424-4971-4af0-bb7e-19455530de2e is going to be updated. [ 643.435319] env[66519]: INFO networking_nsxv3.common.synchronization [None req-35b905d6-38ea-4797-a676-344c5272ff09 None None] Enqueued Resource ID: cdf27904-74d8-4e06-b69b-949d1ddb7e0b with Priority: HIGHEST for action port [ 643.436620] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf27904-74d8-4e06-b69b-949d1ddb7e0b with Priority: HIGHEST for action port [ 643.436944] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdf27904-74d8-4e06-b69b-949d1ddb7e0b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.437087] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdf27904-74d8-4e06-b69b-949d1ddb7e0b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.437157] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdf27904-74d8-4e06-b69b-949d1ddb7e0b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.437443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdf27904-74d8-4e06-b69b-949d1ddb7e0b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.437542] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdf27904-74d8-4e06-b69b-949d1ddb7e0b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.476196] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.476400] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.476400] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.476618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.476787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.488222] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce52e424-4971-4af0-bb7e-19455530de2e in Status: IN_PROGRESS for 2s [ 643.611239] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.611239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.611239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.611239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.611239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.611239] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.611239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.611239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.611239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.611239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.611239] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2713653c-36b0-489e-8ec3-6cae0694eead already deleted. [ 643.611239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.770675] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-401 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.770883] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-401" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.771010] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-401" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.772312] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-401" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.772596] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.772764] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.772872] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.776043] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.776043] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.776043] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.776043] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.776043] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.776043] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.776043] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.776043] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.776043] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.796029] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.796029] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 643.796029] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.796029] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-401" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.796029] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-0908385d-3586-4788-b053-2dad64b410d1 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.796029] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-0908385d-3586-4788-b053-2dad64b410d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.796029] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-0908385d-3586-4788-b053-2dad64b410d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.796029] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-0908385d-3586-4788-b053-2dad64b410d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.796029] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0908385d-3586-4788-b053-2dad64b410d1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.931036] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.931218] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.931259] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.931460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.931548] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.931644] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6960f374-b898-4940-b626-d2d9b6819605 is going to be updated. [ 643.945823] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdf27904-74d8-4e06-b69b-949d1ddb7e0b [ 643.945823] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.945823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.945823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.945823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.945823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.945823] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdf27904-74d8-4e06-b69b-949d1ddb7e0b already deleted. [ 643.945823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdf27904-74d8-4e06-b69b-949d1ddb7e0b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.947741] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.947877] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.947948] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.949278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.949278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.949278] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a already deleted. [ 643.949278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.963808] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.964022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.964022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.964426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.964426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.976051] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6960f374-b898-4940-b626-d2d9b6819605 in Status: IN_PROGRESS for 2s [ 644.298823] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.299193] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.299193] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.299536] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.299772] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.299957] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 0908385d-3586-4788-b053-2dad64b410d1 not found, creating... [ 644.300244] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.300402] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.300514] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.300731] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.300863] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.301176] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.301347] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.301535] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.301755] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.301890] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.302036] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 0908385d-3586-4788-b053-2dad64b410d1 is going to be created. [ 644.336464] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.336691] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.336784] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.337088] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.337348] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.337569] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-0908385d-3586-4788-b053-2dad64b410d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.448767] env[66519]: INFO networking_nsxv3.common.synchronization [None req-f18c7641-0fa4-4eaa-ba7e-57bc1968a804 None None] Enqueued Resource ID: 806d29a2-98ac-4392-912b-60a49c4598c9 with Priority: HIGHEST for action port [ 644.449345] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 806d29a2-98ac-4392-912b-60a49c4598c9 with Priority: HIGHEST for action port [ 644.451826] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-806d29a2-98ac-4392-912b-60a49c4598c9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.452086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-806d29a2-98ac-4392-912b-60a49c4598c9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.452212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-806d29a2-98ac-4392-912b-60a49c4598c9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.452435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-806d29a2-98ac-4392-912b-60a49c4598c9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.452541] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('806d29a2-98ac-4392-912b-60a49c4598c9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.647848] env[66519]: INFO networking_nsxv3.common.synchronization [None req-242f8da4-e577-4e5c-98b3-ae86497886dc tempest-ServerActionsV293TestJSON-1719924090 tempest-ServerActionsV293TestJSON-1719924090-project-member] Enqueued Resource ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a with Priority: HIGHEST for action security_group_rules [ 644.648667] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a with Priority: HIGHEST for action security_group_rules [ 644.648667] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.648835] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.648835] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.649048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.649141] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94ea0731-22a6-40ee-a699-ef5f6ebe0f3a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.956900] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 806d29a2-98ac-4392-912b-60a49c4598c9 [ 644.957179] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.957312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.957373] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.957609] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.957692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.957833] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:806d29a2-98ac-4392-912b-60a49c4598c9 already deleted. [ 644.957903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-806d29a2-98ac-4392-912b-60a49c4598c9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.069167] env[66519]: INFO networking_nsxv3.common.synchronization [req-95c93a13-dbc0-494b-8e72-ff23edd89449 req-0f6c713c-daca-42ab-abbd-1c0cf973dfd9 service nova] Enqueued Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGHEST for action security_group_rules [ 645.069167] env[66519]: INFO networking_nsxv3.common.synchronization [req-95c93a13-dbc0-494b-8e72-ff23edd89449 req-0f6c713c-daca-42ab-abbd-1c0cf973dfd9 service nova] Enqueued Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGHEST for action security_group_members [ 645.069167] env[66519]: INFO networking_nsxv3.common.synchronization [req-95c93a13-dbc0-494b-8e72-ff23edd89449 req-0f6c713c-daca-42ab-abbd-1c0cf973dfd9 service nova] Enqueued Resource ID: 0908385d-3586-4788-b053-2dad64b410d1 with Priority: HIGHEST for action port [ 645.069167] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGHEST for action security_group_rules [ 645.069167] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGHEST for action security_group_members [ 645.069167] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0908385d-3586-4788-b053-2dad64b410d1 with Priority: HIGHEST for action port [ 645.069167] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.069167] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.069167] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.069167] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.069167] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.071766] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.074737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.074737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.074737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.075073] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.075073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.075174] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.075890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.075890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.075890] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.076749] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-0908385d-3586-4788-b053-2dad64b410d1 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.076749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0908385d-3586-4788-b053-2dad64b410d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.076749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0908385d-3586-4788-b053-2dad64b410d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.077144] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0908385d-3586-4788-b053-2dad64b410d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.077144] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0908385d-3586-4788-b053-2dad64b410d1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.169361] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.169508] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.169508] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.169834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.169834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.169834] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a already deleted. [ 645.170030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.501339] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce52e424-4971-4af0-bb7e-19455530de2e in Status: SUCCESS [ 645.501747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.502053] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.502161] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.502744] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.502744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.502744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.502956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.502956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.503034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.503139] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.580205] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.582953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.582953] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.582953] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0908385d-3586-4788-b053-2dad64b410d1 with status ACTIVE [ 645.582953] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.582953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.582953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.582953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.582953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.582953] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.582953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.582953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.582953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.582953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.584960] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.585819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.585919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.586145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.586357] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.586357] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0908385d-3586-4788-b053-2dad64b410d1 is going to be updated. [ 645.610406] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.610406] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.610406] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.610652] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.610687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.612355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0908385d-3586-4788-b053-2dad64b410d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.991604] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6960f374-b898-4940-b626-d2d9b6819605 in Status: SUCCESS [ 645.991604] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.991604] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.993539] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.993881] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.994113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.994269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.994585] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.994739] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.994900] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.995107] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6960f374-b898-4940-b626-d2d9b6819605',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.007104] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.007910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.007910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.007910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.008296] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.008296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.008499] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.010937] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.011232] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.011494] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.012964] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.013325] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.013440] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.013735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.014064] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.014208] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.014698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.014698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.014868] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.014963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.015042] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.088720] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.301415] env[66519]: INFO networking_nsxv3.common.synchronization [req-9d813766-dd90-4352-b8df-8728a7d0ccb6 req-4aa89419-f537-4ca2-b5f8-792b6b721dfc tempest-ImagesOneServerNegativeTestJSON-1631615325 tempest-ImagesOneServerNegativeTestJSON-1631615325-project-member] Enqueued Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_members [ 646.302076] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_members [ 646.302396] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.302518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.302584] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.302881] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.303303] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.303401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.303401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.303551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.305173] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.305173] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.500774] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6960f374-b898-4940-b626-d2d9b6819605 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.500920] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.500966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.501225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.501483] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.501724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.501724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.501811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.502274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.502274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.502274] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6960f374-b898-4940-b626-d2d9b6819605 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.502274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.502274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.502492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.502582] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.502701] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.502768] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.503137] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.503137] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.503137] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.503273] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6960f374-b898-4940-b626-d2d9b6819605',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.518224] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce52e424-4971-4af0-bb7e-19455530de2e: rpc.has_security_group_logging(os_id): False [ 646.542326] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.542613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.542613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.542806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.542894] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.543243] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.543243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.543355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.543479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.543561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.543752] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.543843] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.543903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.544056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.544127] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.544324] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.544414] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.544474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.544634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.544704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.544847] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce52e424-4971-4af0-bb7e-19455530de2e is going to be updated. [ 646.594097] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.594097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.594397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.594397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.594771] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.594771] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2713653c-36b0-489e-8ec3-6cae0694eead is going to be created. [ 646.625085] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.625268] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.625326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.625700] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.625798] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.646228] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2713653c-36b0-489e-8ec3-6cae0694eead in Status: UNINITIALIZED for 2s [ 646.646839] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.647045] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.647147] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.647413] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.647617] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.664944] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce52e424-4971-4af0-bb7e-19455530de2e in Status: IN_PROGRESS for 2s [ 646.809610] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.810234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.810391] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.810947] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.811141] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.811397] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.811520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.811589] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.811772] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.811859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.811944] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ed5e58-fb42-4430-8674-e9d732009460 already deleted. [ 646.812037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.896038] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-889 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.896218] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-889" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.896324] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-889" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.896643] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-889" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.898047] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.898047] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.898047] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.898047] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.898326] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.898326] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.898423] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 646.898525] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 646.898852] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 646.898972] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.899106] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 646.899236] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 646.926465] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 646.926465] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 646.926465] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 646.926465] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-889" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.926465] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-6b00520b-a533-46e3-9cfe-c65b9751a700 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.926465] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-6b00520b-a533-46e3-9cfe-c65b9751a700" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.926465] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-6b00520b-a533-46e3-9cfe-c65b9751a700" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.926465] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-6b00520b-a533-46e3-9cfe-c65b9751a700" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.926465] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b00520b-a533-46e3-9cfe-c65b9751a700',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.008564] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6960f374-b898-4940-b626-d2d9b6819605: rpc.has_security_group_logging(os_id): False [ 647.030677] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.031653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.031653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.031653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.031653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.031653] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.031653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.031653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.031952] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.031952] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.032792] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.032792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.032792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.032792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.032792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.032792] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.032792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.033093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.033093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.033093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.033197] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6960f374-b898-4940-b626-d2d9b6819605 is going to be updated. [ 647.110692] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.110692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.110692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.110978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.110978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.130375] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6960f374-b898-4940-b626-d2d9b6819605 in Status: IN_PROGRESS for 2s [ 647.144273] env[66519]: INFO networking_nsxv3.common.synchronization [None req-9d08c47e-cae4-427b-9eea-d17e97485e33 None None] Enqueued Resource ID: 4c7de297-b5e0-4b2a-9b18-75387bd4dbff with Priority: HIGHEST for action port [ 647.145537] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c7de297-b5e0-4b2a-9b18-75387bd4dbff with Priority: HIGHEST for action port [ 647.146143] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c7de297-b5e0-4b2a-9b18-75387bd4dbff taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.146302] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c7de297-b5e0-4b2a-9b18-75387bd4dbff" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.146387] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c7de297-b5e0-4b2a-9b18-75387bd4dbff" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.146680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c7de297-b5e0-4b2a-9b18-75387bd4dbff" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.146773] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c7de297-b5e0-4b2a-9b18-75387bd4dbff',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.434036] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.434645] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.434645] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.434836] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.434911] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.435200] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 6b00520b-a533-46e3-9cfe-c65b9751a700 not found, creating... [ 647.436019] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.436019] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.436019] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.436226] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.436226] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.436499] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.436655] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.436789] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.436977] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.437487] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.437633] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 6b00520b-a533-46e3-9cfe-c65b9751a700 is going to be created. [ 647.464194] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.464194] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.464194] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.464194] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.464194] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.464194] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-6b00520b-a533-46e3-9cfe-c65b9751a700" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.649369] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c7de297-b5e0-4b2a-9b18-75387bd4dbff [ 647.649663] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.649863] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.649935] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.650169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.650258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.650354] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c7de297-b5e0-4b2a-9b18-75387bd4dbff already deleted. [ 647.650435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c7de297-b5e0-4b2a-9b18-75387bd4dbff" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.059374] env[66519]: INFO networking_nsxv3.common.synchronization [None req-0a0a52f6-dd94-43ce-993d-41ef5e2f3c54 None None] Enqueued Resource ID: 275f5072-bb3a-4534-b26a-dfd013b501b1 with Priority: HIGHEST for action port [ 648.060318] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 275f5072-bb3a-4534-b26a-dfd013b501b1 with Priority: HIGHEST for action port [ 648.060957] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-275f5072-bb3a-4534-b26a-dfd013b501b1 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.060957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-275f5072-bb3a-4534-b26a-dfd013b501b1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.060957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-275f5072-bb3a-4534-b26a-dfd013b501b1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.061517] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-275f5072-bb3a-4534-b26a-dfd013b501b1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.061635] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('275f5072-bb3a-4534-b26a-dfd013b501b1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.198949] env[66519]: INFO networking_nsxv3.common.synchronization [req-9d813766-dd90-4352-b8df-8728a7d0ccb6 req-10c8981a-034d-4f38-b0ba-2b98a12f85a5 service nova] Enqueued Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_rules [ 648.200167] env[66519]: INFO networking_nsxv3.common.synchronization [req-9d813766-dd90-4352-b8df-8728a7d0ccb6 req-10c8981a-034d-4f38-b0ba-2b98a12f85a5 service nova] Enqueued Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_members [ 648.200357] env[66519]: INFO networking_nsxv3.common.synchronization [req-9d813766-dd90-4352-b8df-8728a7d0ccb6 req-10c8981a-034d-4f38-b0ba-2b98a12f85a5 service nova] Enqueued Resource ID: 6b00520b-a533-46e3-9cfe-c65b9751a700 with Priority: HIGHEST for action port [ 648.200928] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_rules [ 648.201091] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_members [ 648.201223] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b00520b-a533-46e3-9cfe-c65b9751a700 with Priority: HIGHEST for action port [ 648.201466] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.201604] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.201642] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.201920] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.202027] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.203572] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.203693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.203763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.203957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.204129] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.204234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.204297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.204450] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.204533] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.204625] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.205539] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b00520b-a533-46e3-9cfe-c65b9751a700 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.205689] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b00520b-a533-46e3-9cfe-c65b9751a700" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.205779] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b00520b-a533-46e3-9cfe-c65b9751a700" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.205995] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b00520b-a533-46e3-9cfe-c65b9751a700" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.206144] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b00520b-a533-46e3-9cfe-c65b9751a700',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.563758] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 275f5072-bb3a-4534-b26a-dfd013b501b1 [ 648.565443] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.565443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.565443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.565443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.565443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.565443] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:275f5072-bb3a-4534-b26a-dfd013b501b1 already deleted. [ 648.565443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-275f5072-bb3a-4534-b26a-dfd013b501b1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.568968] env[66519]: INFO networking_nsxv3.common.synchronization [req-323278a4-bb4b-4daa-9f03-968265b0d60c req-7f1161f1-d3a8-4b4f-b305-8a5a250f3ee7 tempest-ServersTestMultiNic-666815749 tempest-ServersTestMultiNic-666815749-project-member] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 648.569531] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 648.569975] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.576825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.576825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.576825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.576825] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.576825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.576825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.576825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.576825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.576825] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.656640] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2713653c-36b0-489e-8ec3-6cae0694eead in Status: SUCCESS [ 648.657098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.657098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.657286] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.657487] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.657608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.657672] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.657827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.657999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.657999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.658100] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.680643] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce52e424-4971-4af0-bb7e-19455530de2e in Status: SUCCESS [ 648.680643] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.708191] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.709386] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.710351] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.712876] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6b00520b-a533-46e3-9cfe-c65b9751a700 with status ACTIVE [ 648.712876] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.712876] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.712876] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.712876] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.712876] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.712876] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.712876] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.713380] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.713380] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.713380] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.713684] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.713684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.713813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.713903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.714267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.714267] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6b00520b-a533-46e3-9cfe-c65b9751a700 is going to be updated. [ 648.739141] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.739280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.739381] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.739681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.739785] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.739994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b00520b-a533-46e3-9cfe-c65b9751a700" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.871478] env[66519]: INFO networking_nsxv3.common.synchronization [req-1446ee88-096c-4259-b6cf-ccb22f0624dc req-70cd8756-5a75-4de1-bfdf-33f3dc599e68 tempest-ServerAddressesTestJSON-495609721 tempest-ServerAddressesTestJSON-495609721-project-member] Enqueued Resource ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 with Priority: HIGHEST for action security_group_members [ 648.873471] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 with Priority: HIGHEST for action security_group_members [ 648.873914] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f40915ba-8560-4243-a90e-1d2bc4bfd564 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.874071] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.874142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.874362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.874587] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.874705] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.874769] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.874985] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.875084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.875769] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f40915ba-8560-4243-a90e-1d2bc4bfd564',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.928037] env[66519]: INFO networking_nsxv3.common.synchronization [req-e35446fb-4d0e-417d-86cb-1bb034f41d4f req-d69693fe-b8f0-464b-82ba-682fd8a208c1 tempest-TenantUsagesTestJSON-1546157383 tempest-TenantUsagesTestJSON-1546157383-project-member] Enqueued Resource ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a with Priority: HIGHEST for action security_group_members [ 648.928280] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a with Priority: HIGHEST for action security_group_members [ 648.928597] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bb323a7-1c72-4a14-b96f-1b609dfc553a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.928723] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.928792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.928996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.929332] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.929469] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.929511] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.929662] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.930034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.930610] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bb323a7-1c72-4a14-b96f-1b609dfc553a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.079661] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.149110] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6960f374-b898-4940-b626-d2d9b6819605 in Status: SUCCESS [ 649.149110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.168023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.168023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.168023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.168023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.168023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.168023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.168023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.168023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.168023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.168023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.168023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.168023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.168023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.168023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.168023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.168023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.168753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.168753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.168753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.168753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.168753] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.212030] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.243520] env[66519]: INFO networking_nsxv3.common.synchronization [req-b171718a-8be1-4593-be03-a29fd78789fe req-c49d75cb-11f7-4980-90ef-383516a55687 tempest-ServerRescueNegativeTestJSON-912870119 tempest-ServerRescueNegativeTestJSON-912870119-project-member] Enqueued Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGHEST for action security_group_members [ 649.245035] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGHEST for action security_group_members [ 649.246029] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.246235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.246365] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.246651] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.246877] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.247035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.247155] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.247368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.247479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.247617] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.382032] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.382501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.382501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.383163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.383349] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.383590] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.383798] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.383798] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.384017] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.384118] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.384179] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 is going to be updated. [ 649.419877] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.420134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.420933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.420933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.420933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.432503] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.432706] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.432844] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.436607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.436818] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.437159] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.437334] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.437334] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.438059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.438059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.438059] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a is going to be updated. [ 649.439905] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 in Status: IN_PROGRESS for 2s [ 649.479670] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.479879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.479990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.480312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.480506] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.500867] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a in Status: IN_PROGRESS for 2s [ 649.583268] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.670523] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2713653c-36b0-489e-8ec3-6cae0694eead: rpc.has_security_group_logging(os_id): False [ 649.698600] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.698739] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.698781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.703471] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.703471] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.703471] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.703471] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.703471] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.703471] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.703471] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.703907] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.703907] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.703907] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.704321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.704321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.704425] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.704480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.704529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.704661] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.704733] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.704862] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2713653c-36b0-489e-8ec3-6cae0694eead is going to be created. [ 649.708755] env[66519]: INFO networking_nsxv3.common.synchronization [req-323278a4-bb4b-4daa-9f03-968265b0d60c req-f017e1a8-1559-4729-b192-d922ba93d416 tempest-ServersTestMultiNic-666815749 tempest-ServersTestMultiNic-666815749-project-member] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 649.709373] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 649.709748] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.709848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.715174] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.715174] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.715400] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.715687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.715912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.716246] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ed5e58-fb42-4430-8674-e9d732009460 is going to be created. [ 649.745811] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.746113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.746113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.746287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.746643] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.753571] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.760308] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: UNINITIALIZED for 2s [ 649.783435] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.783435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.783435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.783435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.783435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.796718] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2713653c-36b0-489e-8ec3-6cae0694eead in Status: IN_PROGRESS for 2s [ 650.085797] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.086067] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.086140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.086434] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.086573] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.086690] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac is going to be updated. [ 650.122969] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.123212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.123212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.123504] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.123681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.142028] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: IN_PROGRESS for 2s [ 650.256165] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.293170] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-401 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.293473] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-401" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.293641] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-401" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.293998] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-401" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.296468] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.296775] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.296906] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.297194] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.297340] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.297929] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.297929] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.297929] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.297929] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.298093] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.298610] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.298747] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.303866] env[66519]: INFO networking_nsxv3.common.synchronization [req-323278a4-bb4b-4daa-9f03-968265b0d60c req-9280faeb-6355-406e-a622-c2c565ccce08 tempest-ServersTestMultiNic-666815749 tempest-ServersTestMultiNic-666815749-project-member] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 650.305678] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 650.306129] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.306256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.333728] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.333728] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 650.333728] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.333728] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-401" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.334176] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-98384fe4-8963-4b10-8243-3121dac92883 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.334303] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-98384fe4-8963-4b10-8243-3121dac92883" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.334754] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-98384fe4-8963-4b10-8243-3121dac92883" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.334944] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-98384fe4-8963-4b10-8243-3121dac92883" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.334944] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98384fe4-8963-4b10-8243-3121dac92883',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.759480] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.759920] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.759920] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.760156] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.760305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.760699] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2713653c-36b0-489e-8ec3-6cae0694eead is going to be updated. [ 650.767477] env[66519]: INFO networking_nsxv3.common.synchronization [None req-32f99a03-1e93-40dd-a399-75297cc15be2 None None] Enqueued Resource ID: 9d0ad68b-bb52-4d60-80c0-fa821b68120c with Priority: HIGHEST for action port [ 650.768223] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d0ad68b-bb52-4d60-80c0-fa821b68120c with Priority: HIGHEST for action port [ 650.768590] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d0ad68b-bb52-4d60-80c0-fa821b68120c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.768757] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d0ad68b-bb52-4d60-80c0-fa821b68120c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.768826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d0ad68b-bb52-4d60-80c0-fa821b68120c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.769089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d0ad68b-bb52-4d60-80c0-fa821b68120c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.769176] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d0ad68b-bb52-4d60-80c0-fa821b68120c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.793123] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.793123] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.793123] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.793354] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.794024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.811352] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2713653c-36b0-489e-8ec3-6cae0694eead in Status: IN_PROGRESS for 2s [ 650.837571] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.837951] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.837951] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.838270] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.838418] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.838566] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 98384fe4-8963-4b10-8243-3121dac92883 not found, creating... [ 650.838886] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.839068] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.839191] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.839422] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.839656] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.839827] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.839974] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.840134] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.840313] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.840501] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.840647] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 98384fe4-8963-4b10-8243-3121dac92883 is going to be created. [ 650.870142] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.870142] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.870142] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.870142] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.870397] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.870566] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-98384fe4-8963-4b10-8243-3121dac92883" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.228315] env[66519]: INFO networking_nsxv3.common.synchronization [None req-2ecfddcf-c839-4668-ad52-0de3ff0be38d None None] Enqueued Resource ID: faf4799d-e0df-478f-8eb4-ef1d23ad810d with Priority: HIGHEST for action port [ 651.230027] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faf4799d-e0df-478f-8eb4-ef1d23ad810d with Priority: HIGHEST for action port [ 651.230224] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-faf4799d-e0df-478f-8eb4-ef1d23ad810d taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.230358] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-faf4799d-e0df-478f-8eb4-ef1d23ad810d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.230424] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-faf4799d-e0df-478f-8eb4-ef1d23ad810d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.230716] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-faf4799d-e0df-478f-8eb4-ef1d23ad810d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.230799] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('faf4799d-e0df-478f-8eb4-ef1d23ad810d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.271906] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d0ad68b-bb52-4d60-80c0-fa821b68120c [ 651.272223] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.272397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.272468] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.272892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.272892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.272892] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d0ad68b-bb52-4d60-80c0-fa821b68120c already deleted. [ 651.273104] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d0ad68b-bb52-4d60-80c0-fa821b68120c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.451951] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 in Status: SUCCESS [ 651.451951] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 deletion is rescheduled due to dependency. [ 651.451951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.511448] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a in Status: SUCCESS [ 651.511665] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a deletion is rescheduled due to dependency. [ 651.511814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.588892] env[66519]: INFO networking_nsxv3.common.synchronization [req-b171718a-8be1-4593-be03-a29fd78789fe req-d27ed101-108f-4695-be47-2b61c12174f0 service nova] Enqueued Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGHEST for action security_group_rules [ 651.589084] env[66519]: INFO networking_nsxv3.common.synchronization [req-b171718a-8be1-4593-be03-a29fd78789fe req-d27ed101-108f-4695-be47-2b61c12174f0 service nova] Enqueued Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGHEST for action security_group_members [ 651.589216] env[66519]: INFO networking_nsxv3.common.synchronization [req-b171718a-8be1-4593-be03-a29fd78789fe req-d27ed101-108f-4695-be47-2b61c12174f0 service nova] Enqueued Resource ID: 98384fe4-8963-4b10-8243-3121dac92883 with Priority: HIGHEST for action port [ 651.590082] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGHEST for action security_group_rules [ 651.590082] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGHEST for action security_group_members [ 651.590082] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98384fe4-8963-4b10-8243-3121dac92883 with Priority: HIGHEST for action port [ 651.593909] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.593909] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.593909] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.593909] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.593909] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-98384fe4-8963-4b10-8243-3121dac92883 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.593909] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98384fe4-8963-4b10-8243-3121dac92883" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.593909] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98384fe4-8963-4b10-8243-3121dac92883" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.593909] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98384fe4-8963-4b10-8243-3121dac92883" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.594414] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98384fe4-8963-4b10-8243-3121dac92883',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.735262] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port faf4799d-e0df-478f-8eb4-ef1d23ad810d [ 651.735262] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.735262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.735262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.735262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.735262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.735262] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:faf4799d-e0df-478f-8eb4-ef1d23ad810d already deleted. [ 651.735526] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-faf4799d-e0df-478f-8eb4-ef1d23ad810d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.771966] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: SUCCESS [ 651.772273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.772522] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.774682] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.774922] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.775114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.775209] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.776229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.776229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.776229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.776229] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.811471] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2713653c-36b0-489e-8ec3-6cae0694eead in Status: SUCCESS [ 651.812393] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.812393] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.812549] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.812633] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.102523] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98384fe4-8963-4b10-8243-3121dac92883 with status ACTIVE [ 652.102523] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.102523] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.102523] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.102711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.102884] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.103129] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.103129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.103266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.103302] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.103391] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.103558] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.103655] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.104666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.104666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.104666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.104666] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98384fe4-8963-4b10-8243-3121dac92883 is going to be updated. [ 652.139436] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.139436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.139436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.139436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.139436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.139765] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98384fe4-8963-4b10-8243-3121dac92883" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.149629] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: SUCCESS [ 652.149774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.149969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.150207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.150425] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.150674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.150674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.150803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.150884] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.150983] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.278541] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.279064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.279125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.279486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.279766] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.279950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.280084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.280434] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.280634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.280831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.281179] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.281386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.281621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.282939] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.285484] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.285711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.285846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.286140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.286317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.286462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.286642] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.316626] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.316851] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.657404] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.657404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.657404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.657404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.657404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.657404] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.657404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.657404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.657404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.657404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.657404] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac is going to be updated. [ 652.706714] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.706961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.706961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.707205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.707356] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.719505] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: IN_PROGRESS for 2s [ 652.790187] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9ed5e58-fb42-4430-8674-e9d732009460: rpc.has_security_group_logging(os_id): False [ 652.815601] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.815601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.815601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.815601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.815601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.815601] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.815601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.815601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.815601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.815601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.815601] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.815601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.815601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.815601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.815601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.816509] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.816821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.817069] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.817641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.818367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.818367] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9ed5e58-fb42-4430-8674-e9d732009460 is going to be created. [ 652.836936] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2713653c-36b0-489e-8ec3-6cae0694eead in Status: SUCCESS [ 652.837126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.838266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.838266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.838266] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.838266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.838266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.838266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.838266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.839949] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.906672] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.907357] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.907357] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.907619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.907874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.928029] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: IN_PROGRESS for 2s [ 653.342464] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.487155] env[66519]: INFO networking_nsxv3.common.synchronization [None req-8bff570d-96b0-421c-b510-ebb44f0c5016 None None] Enqueued Resource ID: cdf734cc-2abe-4d26-9431-0584085d8670 with Priority: HIGHEST for action port [ 653.487851] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cdf734cc-2abe-4d26-9431-0584085d8670 with Priority: HIGHEST for action port [ 653.488261] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-cdf734cc-2abe-4d26-9431-0584085d8670 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.488637] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cdf734cc-2abe-4d26-9431-0584085d8670" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.488637] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cdf734cc-2abe-4d26-9431-0584085d8670" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.489136] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cdf734cc-2abe-4d26-9431-0584085d8670" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.489190] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cdf734cc-2abe-4d26-9431-0584085d8670',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.845914] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.991982] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cdf734cc-2abe-4d26-9431-0584085d8670 [ 653.995733] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.995897] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.995998] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.998349] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.998452] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.998569] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cdf734cc-2abe-4d26-9431-0584085d8670 already deleted. [ 653.998690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cdf734cc-2abe-4d26-9431-0584085d8670" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.348524] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.349701] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.349837] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.350173] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.350318] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.350471] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2713653c-36b0-489e-8ec3-6cae0694eead is going to be updated. [ 654.389983] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.390110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.390169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.390383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.390996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.402770] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2713653c-36b0-489e-8ec3-6cae0694eead in Status: IN_PROGRESS for 2s [ 654.731535] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: SUCCESS [ 654.731744] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac deletion is rescheduled due to dependency. [ 654.731864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.732046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.732261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.732446] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.732631] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.732631] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.732896] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.732973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.733053] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.939187] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: SUCCESS [ 654.939570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.961100] env[66519]: INFO networking_nsxv3.common.synchronization [req-17f65f79-66fe-4218-b3cc-f6d14b996550 req-ea31bfd5-423e-4887-98cc-3b96feeaf658 tempest-ServerDiagnosticsTest-2133965350 tempest-ServerDiagnosticsTest-2133965350-project-member] Enqueued Resource ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a with Priority: HIGHEST for action security_group_members [ 654.961583] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a with Priority: HIGHEST for action security_group_members [ 654.961915] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.962066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.962137] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.962516] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.962704] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.962818] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.962882] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.963065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.963393] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.963393] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc7e1373-9ebc-4cc6-b80c-fa60c152026a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.237940] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.238195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.238195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.238352] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.238542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.238793] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.238939] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.239941] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.240672] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.240837] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.240946] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac is going to be updated. [ 655.291012] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.291775] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.294022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.294022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.294022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.303617] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: IN_PROGRESS for 2s [ 655.465887] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.465887] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.466121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.466269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.466513] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.466702] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.466853] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.466979] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.467207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.467306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.467416] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a already deleted. [ 655.467521] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.494534] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.494889] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.495040] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.495450] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.496323] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.496323] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.496323] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.497292] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.497292] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.497292] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.497482] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.497638] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.497768] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.497963] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.498157] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.498367] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.522393] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.522892] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 655.523207] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.523359] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.523760] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-8d611f9f-4124-4fa9-91ce-49fdb87efc34 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.524030] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-8d611f9f-4124-4fa9-91ce-49fdb87efc34" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.524367] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-8d611f9f-4124-4fa9-91ce-49fdb87efc34" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.525432] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-8d611f9f-4124-4fa9-91ce-49fdb87efc34" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.525432] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d611f9f-4124-4fa9-91ce-49fdb87efc34',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.771350] env[66519]: INFO networking_nsxv3.common.synchronization [None req-2150ce03-8445-4546-9055-6f26d9538663 None None] Enqueued Resource ID: 68652b96-4639-4aa1-ad5d-d776ed655675 with Priority: HIGHEST for action port [ 655.772266] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68652b96-4639-4aa1-ad5d-d776ed655675 with Priority: HIGHEST for action port [ 655.772962] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-68652b96-4639-4aa1-ad5d-d776ed655675 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.774596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68652b96-4639-4aa1-ad5d-d776ed655675" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.774596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68652b96-4639-4aa1-ad5d-d776ed655675" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.774596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68652b96-4639-4aa1-ad5d-d776ed655675" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.774596] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68652b96-4639-4aa1-ad5d-d776ed655675',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.029424] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.029752] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.029752] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.030042] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.030201] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.030351] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 8d611f9f-4124-4fa9-91ce-49fdb87efc34 not found, creating... [ 656.030595] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.030743] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.030850] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.031102] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.031240] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.031510] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.033123] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.033258] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.033479] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.033609] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.033763] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 8d611f9f-4124-4fa9-91ce-49fdb87efc34 is going to be created. [ 656.055264] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.055502] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.055748] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.056172] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.056397] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.056627] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-8d611f9f-4124-4fa9-91ce-49fdb87efc34" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.277272] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68652b96-4639-4aa1-ad5d-d776ed655675 [ 656.277488] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.277651] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.277718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.277952] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.278103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.278210] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68652b96-4639-4aa1-ad5d-d776ed655675 already deleted. [ 656.278325] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68652b96-4639-4aa1-ad5d-d776ed655675" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.415290] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2713653c-36b0-489e-8ec3-6cae0694eead in Status: SUCCESS [ 656.415290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.415290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.417641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.417870] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.418064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.418132] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.418312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.418395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.418875] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.419020] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.923365] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.924311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.924311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.924311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.924311] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.924311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.924549] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.924549] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.924621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.924657] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.924839] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.925036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.925179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.925361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.925533] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.925631] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.925703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.925872] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.926055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.926172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.926270] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.943566] env[66519]: INFO networking_nsxv3.common.synchronization [req-17f65f79-66fe-4218-b3cc-f6d14b996550 req-9f211818-9a0f-4f6c-a73c-ecab0358f611 service nova] Enqueued Resource ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a with Priority: HIGHEST for action security_group_rules [ 656.943848] env[66519]: INFO networking_nsxv3.common.synchronization [req-17f65f79-66fe-4218-b3cc-f6d14b996550 req-9f211818-9a0f-4f6c-a73c-ecab0358f611 service nova] Enqueued Resource ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a with Priority: HIGHEST for action security_group_members [ 656.944032] env[66519]: INFO networking_nsxv3.common.synchronization [req-17f65f79-66fe-4218-b3cc-f6d14b996550 req-9f211818-9a0f-4f6c-a73c-ecab0358f611 service nova] Enqueued Resource ID: 8d611f9f-4124-4fa9-91ce-49fdb87efc34 with Priority: HIGHEST for action port [ 656.944494] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a with Priority: HIGHEST for action security_group_rules [ 656.944644] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a with Priority: HIGHEST for action security_group_members [ 656.944644] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d611f9f-4124-4fa9-91ce-49fdb87efc34 with Priority: HIGHEST for action port [ 656.945525] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc7e1373-9ebc-4cc6-b80c-fa60c152026a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.945839] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.948097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.948097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.948097] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc7e1373-9ebc-4cc6-b80c-fa60c152026a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.951744] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.951744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.951744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.951949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.952144] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.952275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.952359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.952546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.952659] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.952872] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc7e1373-9ebc-4cc6-b80c-fa60c152026a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.954538] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d611f9f-4124-4fa9-91ce-49fdb87efc34 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.954538] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d611f9f-4124-4fa9-91ce-49fdb87efc34" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.954538] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d611f9f-4124-4fa9-91ce-49fdb87efc34" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.954538] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d611f9f-4124-4fa9-91ce-49fdb87efc34" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.954538] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d611f9f-4124-4fa9-91ce-49fdb87efc34',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.319285] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: SUCCESS [ 657.319679] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac deletion is rescheduled due to dependency. [ 657.319679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.396167] env[66519]: INFO networking_nsxv3.common.synchronization [req-8d9fc7ca-8150-4def-a648-e1165a2a8f05 req-97d74758-10bb-4c4c-bfb9-bd4c42c5edff tempest-ImagesOneServerTestJSON-1889945922 tempest-ImagesOneServerTestJSON-1889945922-project-member] Enqueued Resource ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 with Priority: HIGHEST for action security_group_members [ 657.396731] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 with Priority: HIGHEST for action security_group_members [ 657.397031] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.397390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.397566] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.397791] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.398027] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.398178] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.398916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.399235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.399390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.399521] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c764bdd1-e51a-4d68-8351-c0fcec7cc0d1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.429817] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2713653c-36b0-489e-8ec3-6cae0694eead: rpc.has_security_group_logging(os_id): False [ 657.453348] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.453471] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.453560] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.453789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.454046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.454140] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.454235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.454297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.454569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.454569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.454821] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.454821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.455502] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.455502] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.457116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.457116] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.457116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.457116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.457116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.457449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.457449] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2713653c-36b0-489e-8ec3-6cae0694eead is going to be updated. [ 657.458703] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc7e1373-9ebc-4cc6-b80c-fa60c152026a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.460575] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.460967] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.461181] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8d611f9f-4124-4fa9-91ce-49fdb87efc34 with status ACTIVE [ 657.461358] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.461633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.461733] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.462085] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.462085] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.462663] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.462663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.462663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.462663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.462663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.463963] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.463963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.463963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.463963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.463963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.463963] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8d611f9f-4124-4fa9-91ce-49fdb87efc34 is going to be updated. [ 657.496214] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.496453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.496515] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.497094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.497217] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.497495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d611f9f-4124-4fa9-91ce-49fdb87efc34" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.557859] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.557859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.557859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.557859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.557859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.574482] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2713653c-36b0-489e-8ec3-6cae0694eead in Status: IN_PROGRESS for 2s [ 657.892021] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-531 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.892021] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-531" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.892021] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-531" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.892021] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-531" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.892021] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.892496] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.892719] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.893333] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.893602] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.893923] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.894257] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.894645] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.895623] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.895623] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.895623] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.895623] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.901559] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.901695] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.901738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.901919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.902019] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.902216] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.902317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.902379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.902530] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.902606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.902689] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 already deleted. [ 657.902796] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.914365] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.914843] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 657.915073] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.915291] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-531" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.915598] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-1a781bf3-3f54-4924-a1e6-1bf1dd13ed1a taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.915769] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-1a781bf3-3f54-4924-a1e6-1bf1dd13ed1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.915904] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-1a781bf3-3f54-4924-a1e6-1bf1dd13ed1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.916212] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-1a781bf3-3f54-4924-a1e6-1bf1dd13ed1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.916341] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a781bf3-3f54-4924-a1e6-1bf1dd13ed1a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.962110] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc7e1373-9ebc-4cc6-b80c-fa60c152026a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.291035] env[66519]: INFO networking_nsxv3.common.synchronization [None req-5f34aa90-3085-44e9-a282-922797da7ab5 None None] Enqueued Resource ID: 20862a7f-5bc1-4a38-9328-cc5eda473d34 with Priority: HIGHEST for action port [ 658.291300] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20862a7f-5bc1-4a38-9328-cc5eda473d34 with Priority: HIGHEST for action port [ 658.292063] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-20862a7f-5bc1-4a38-9328-cc5eda473d34 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.292063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20862a7f-5bc1-4a38-9328-cc5eda473d34" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.292249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20862a7f-5bc1-4a38-9328-cc5eda473d34" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.292335] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20862a7f-5bc1-4a38-9328-cc5eda473d34" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.292418] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20862a7f-5bc1-4a38-9328-cc5eda473d34',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.540306] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.540306] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.540306] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.540306] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.540306] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.540306] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 1a781bf3-3f54-4924-a1e6-1bf1dd13ed1a not found, creating... [ 658.540306] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.540306] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.540306] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.540306] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.540306] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.546847] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.546847] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.546847] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.546847] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.546847] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.546847] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 1a781bf3-3f54-4924-a1e6-1bf1dd13ed1a is going to be created. [ 658.546847] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.546847] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.546847] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.549281] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.549281] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.549281] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-1a781bf3-3f54-4924-a1e6-1bf1dd13ed1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.549281] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.549281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.549281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.549281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.549281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.549281] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a is going to be created. [ 658.549281] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.549281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.549281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.549281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.549281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.549281] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a in Status: UNINITIALIZED for 2s [ 658.795949] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20862a7f-5bc1-4a38-9328-cc5eda473d34 [ 658.796153] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.796319] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.796393] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.796620] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.796711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.796807] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20862a7f-5bc1-4a38-9328-cc5eda473d34 already deleted. [ 658.796889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20862a7f-5bc1-4a38-9328-cc5eda473d34" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.151687] env[66519]: INFO networking_nsxv3.common.synchronization [req-8d9fc7ca-8150-4def-a648-e1165a2a8f05 req-d3dfe6ad-87a3-4b61-9335-03f2cab846cf service nova] Enqueued Resource ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 with Priority: HIGHEST for action security_group_rules [ 659.151687] env[66519]: INFO networking_nsxv3.common.synchronization [req-8d9fc7ca-8150-4def-a648-e1165a2a8f05 req-d3dfe6ad-87a3-4b61-9335-03f2cab846cf service nova] Enqueued Resource ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 with Priority: HIGHEST for action security_group_members [ 659.151687] env[66519]: INFO networking_nsxv3.common.synchronization [req-8d9fc7ca-8150-4def-a648-e1165a2a8f05 req-d3dfe6ad-87a3-4b61-9335-03f2cab846cf service nova] Enqueued Resource ID: 1a781bf3-3f54-4924-a1e6-1bf1dd13ed1a with Priority: HIGHEST for action port [ 659.151687] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 with Priority: HIGHEST for action security_group_rules [ 659.151687] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 with Priority: HIGHEST for action security_group_members [ 659.151687] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a781bf3-3f54-4924-a1e6-1bf1dd13ed1a with Priority: HIGHEST for action port [ 659.152295] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.152454] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.152526] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.152720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.152800] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c764bdd1-e51a-4d68-8351-c0fcec7cc0d1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.154543] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.154543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.154543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.154543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.154736] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.154793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.154874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.155081] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.155165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.155257] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c764bdd1-e51a-4d68-8351-c0fcec7cc0d1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.157368] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a781bf3-3f54-4924-a1e6-1bf1dd13ed1a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.157368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a781bf3-3f54-4924-a1e6-1bf1dd13ed1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.157368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a781bf3-3f54-4924-a1e6-1bf1dd13ed1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.157368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a781bf3-3f54-4924-a1e6-1bf1dd13ed1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.157368] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a781bf3-3f54-4924-a1e6-1bf1dd13ed1a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.596168] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2713653c-36b0-489e-8ec3-6cae0694eead in Status: SUCCESS [ 659.596168] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.658542] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c764bdd1-e51a-4d68-8351-c0fcec7cc0d1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.660513] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.660645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.660828] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a781bf3-3f54-4924-a1e6-1bf1dd13ed1a with status ACTIVE [ 659.662079] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.662079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.662079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.662079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.662079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.662323] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.662323] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.662323] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.662441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.662675] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.662675] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.662825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.662825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.662986] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.663337] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.663449] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a781bf3-3f54-4924-a1e6-1bf1dd13ed1a is going to be updated. [ 659.688980] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.689197] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.689270] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.689456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.689596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.689760] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a781bf3-3f54-4924-a1e6-1bf1dd13ed1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.165432] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c764bdd1-e51a-4d68-8351-c0fcec7cc0d1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.546626] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a in Status: SUCCESS [ 660.547257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.547257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.547662] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.548285] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.548285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.548285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.548621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.548621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.548621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.548621] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc7e1373-9ebc-4cc6-b80c-fa60c152026a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.669288] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.669590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.669590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.669802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.669889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.669985] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 is going to be created. [ 660.698916] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.698916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.698916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.699154] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.699265] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.709912] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 in Status: UNINITIALIZED for 2s [ 660.732741] env[66519]: INFO networking_nsxv3.common.synchronization [None req-1256839d-ed00-4257-8378-394892ea4014 None None] Enqueued Resource ID: cc4ff7f2-d5de-4e4c-8930-ce9284f6a75f with Priority: HIGHEST for action port [ 660.732741] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc4ff7f2-d5de-4e4c-8930-ce9284f6a75f with Priority: HIGHEST for action port [ 660.732741] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc4ff7f2-d5de-4e4c-8930-ce9284f6a75f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.732741] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc4ff7f2-d5de-4e4c-8930-ce9284f6a75f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.732741] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc4ff7f2-d5de-4e4c-8930-ce9284f6a75f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.732741] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc4ff7f2-d5de-4e4c-8930-ce9284f6a75f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.732741] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc4ff7f2-d5de-4e4c-8930-ce9284f6a75f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.054483] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.054483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.054483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.054483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.054483] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.054841] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.054841] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.054841] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.054841] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.054993] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.055076] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.055214] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.055283] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.055467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.055673] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.055789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.055903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.056060] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.056148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.056236] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.056325] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc7e1373-9ebc-4cc6-b80c-fa60c152026a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.237068] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc4ff7f2-d5de-4e4c-8930-ce9284f6a75f [ 661.237068] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.237068] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.237068] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.237458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.237509] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.237797] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc4ff7f2-d5de-4e4c-8930-ce9284f6a75f already deleted. [ 661.237797] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc4ff7f2-d5de-4e4c-8930-ce9284f6a75f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.561475] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc7e1373-9ebc-4cc6-b80c-fa60c152026a: rpc.has_security_group_logging(os_id): False [ 661.591646] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.591859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.592063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.593144] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.593326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.593797] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.594159] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.594352] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.596205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.596205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.596205] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.596205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.596205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.596205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.596205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.596776] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.596960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.597103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.598062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.598062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.598062] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a is going to be created. [ 661.681466] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.681466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.681466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.681466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.681466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.696909] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a in Status: IN_PROGRESS for 2s [ 662.158761] env[66519]: INFO networking_nsxv3.common.synchronization [None req-a55229f5-706e-49ad-9e46-3b51b8a01bb2 tempest-ServersTestBootFromVolume-1611733282 tempest-ServersTestBootFromVolume-1611733282-project-member] Enqueued Resource ID: 245777f4-8235-4258-8d94-22f44ade6a9c with Priority: HIGHEST for action security_group_rules [ 662.158878] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 245777f4-8235-4258-8d94-22f44ade6a9c with Priority: HIGHEST for action security_group_rules [ 662.159194] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-245777f4-8235-4258-8d94-22f44ade6a9c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.159332] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.159409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.159715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.159814] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('245777f4-8235-4258-8d94-22f44ade6a9c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.361232] env[66519]: INFO networking_nsxv3.common.synchronization [req-0f5019d6-bd2b-4ee7-889f-801a44f0477d req-42608175-ddf4-495b-9a12-2201838f0167 tempest-SecurityGroupRulesTestJSON-2035222242 tempest-SecurityGroupRulesTestJSON-2035222242-project-member] Enqueued Resource ID: b514e7fa-b164-4fff-a17b-451d75fd92cc with Priority: HIGHEST for action security_group_rules [ 662.362189] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b514e7fa-b164-4fff-a17b-451d75fd92cc with Priority: HIGHEST for action security_group_rules [ 662.362777] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b514e7fa-b164-4fff-a17b-451d75fd92cc taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.363064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b514e7fa-b164-4fff-a17b-451d75fd92cc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.363252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b514e7fa-b164-4fff-a17b-451d75fd92cc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.363737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b514e7fa-b164-4fff-a17b-451d75fd92cc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.363915] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b514e7fa-b164-4fff-a17b-451d75fd92cc',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.514466] env[66519]: INFO networking_nsxv3.common.synchronization [None req-5337c95a-6b02-44f1-a3ee-790597b0e42c tempest-ServersTestBootFromVolume-1611733282 tempest-ServersTestBootFromVolume-1611733282-project-member] Enqueued Resource ID: 245777f4-8235-4258-8d94-22f44ade6a9c with Priority: HIGHEST for action security_group_rules [ 662.515665] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 245777f4-8235-4258-8d94-22f44ade6a9c with Priority: HIGHEST for action security_group_rules [ 662.515665] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-245777f4-8235-4258-8d94-22f44ade6a9c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.516648] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.700072] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.700072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.700072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.700712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.700712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.700712] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 245777f4-8235-4258-8d94-22f44ade6a9c already deleted. [ 662.700712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.700712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.701030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.701030] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('245777f4-8235-4258-8d94-22f44ade6a9c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.724817] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 in Status: SUCCESS [ 662.724817] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.727094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.727094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.727094] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.727094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.727094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.727094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.727094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.727094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.727094] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c764bdd1-e51a-4d68-8351-c0fcec7cc0d1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.890778] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.890925] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.890991] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.891253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.891341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.891436] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b514e7fa-b164-4fff-a17b-451d75fd92cc already deleted. [ 662.891522] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b514e7fa-b164-4fff-a17b-451d75fd92cc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.227732] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.229383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.229383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.229383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.229383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.229383] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 245777f4-8235-4258-8d94-22f44ade6a9c already deleted. [ 663.229383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.229383] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.229383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.229383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.229383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.229383] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.229383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.229972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.229972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.229972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.229972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.229972] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.229972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.230393] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.230747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.231139] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.231346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.231434] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.231605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.231792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.231792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.231908] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c764bdd1-e51a-4d68-8351-c0fcec7cc0d1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.710172] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a in Status: SUCCESS [ 663.710172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.735521] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c764bdd1-e51a-4d68-8351-c0fcec7cc0d1: rpc.has_security_group_logging(os_id): False [ 663.757034] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.757034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.757034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.757034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.757034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.757034] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.757034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.757438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.757438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.757438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.758345] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.758953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.758953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.758953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.758953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.759117] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.759210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.759266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.759435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.759535] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.759628] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 is going to be created. [ 663.821319] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.823617] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.823763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.823934] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.824138] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.837263] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 in Status: IN_PROGRESS for 2s [ 663.949943] env[66519]: INFO networking_nsxv3.common.synchronization [None req-370e4977-7c55-4405-a103-a12a27947dd8 None None] Enqueued Resource ID: 12e6ea4e-eac6-4367-bc22-351551a03c33 with Priority: HIGHEST for action port [ 663.952155] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12e6ea4e-eac6-4367-bc22-351551a03c33 with Priority: HIGHEST for action port [ 663.952551] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-12e6ea4e-eac6-4367-bc22-351551a03c33 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.952710] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12e6ea4e-eac6-4367-bc22-351551a03c33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.952787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12e6ea4e-eac6-4367-bc22-351551a03c33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.953172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12e6ea4e-eac6-4367-bc22-351551a03c33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.953172] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12e6ea4e-eac6-4367-bc22-351551a03c33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.381302] env[66519]: INFO networking_nsxv3.common.synchronization [req-743365bf-72a0-4a33-94e0-6202e94edd52 req-99947725-fd75-4789-92ef-5594f0ccf249 tempest-SecurityGroupRulesTestJSON-2035222242 tempest-SecurityGroupRulesTestJSON-2035222242-project-member] Enqueued Resource ID: b514e7fa-b164-4fff-a17b-451d75fd92cc with Priority: HIGHEST for action security_group_rules [ 664.382032] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b514e7fa-b164-4fff-a17b-451d75fd92cc with Priority: HIGHEST for action security_group_rules [ 664.382651] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b514e7fa-b164-4fff-a17b-451d75fd92cc taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.382651] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b514e7fa-b164-4fff-a17b-451d75fd92cc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.382651] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b514e7fa-b164-4fff-a17b-451d75fd92cc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.382932] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b514e7fa-b164-4fff-a17b-451d75fd92cc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.382932] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b514e7fa-b164-4fff-a17b-451d75fd92cc',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.457894] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12e6ea4e-eac6-4367-bc22-351551a03c33 [ 664.458184] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.458333] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.458490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.458746] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.458836] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.458966] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12e6ea4e-eac6-4367-bc22-351551a03c33 already deleted. [ 664.459059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12e6ea4e-eac6-4367-bc22-351551a03c33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.909188] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.909459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.909459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.909605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.909688] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.909776] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b514e7fa-b164-4fff-a17b-451d75fd92cc already deleted. [ 664.909858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b514e7fa-b164-4fff-a17b-451d75fd92cc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.853230] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 in Status: SUCCESS [ 665.853439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.121093] env[66519]: INFO networking_nsxv3.common.synchronization [req-00f9c4fc-048f-4dc3-ba00-880f7b6541b3 req-530814dc-6d4d-40ed-b775-ba1c764cd8f8 tempest-DeleteServersAdminTestJSON-67108890 tempest-DeleteServersAdminTestJSON-67108890-project-member] Enqueued Resource ID: 6960f374-b898-4940-b626-d2d9b6819605 with Priority: HIGHEST for action security_group_members [ 667.121737] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6960f374-b898-4940-b626-d2d9b6819605 with Priority: HIGHEST for action security_group_members [ 667.122222] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6960f374-b898-4940-b626-d2d9b6819605 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.122439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.122439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.122693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.122902] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.122998] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.123114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.123385] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.123461] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.123575] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6960f374-b898-4940-b626-d2d9b6819605',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.625828] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.626011] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.626180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.626340] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.626454] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.626800] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.626800] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.626800] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.627051] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.627051] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.627197] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6960f374-b898-4940-b626-d2d9b6819605 is going to be updated. [ 667.662455] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.663292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.663292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.663292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.663292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.676367] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6960f374-b898-4940-b626-d2d9b6819605 in Status: IN_PROGRESS for 2s [ 667.977579] env[66519]: INFO networking_nsxv3.common.synchronization [req-c81d2e04-ec81-4843-8cdb-a8a0928d1fc4 req-96329e17-58ac-4c89-b883-d6b630a32c81 tempest-SecurityGroupRulesTestJSON-2035222242 tempest-SecurityGroupRulesTestJSON-2035222242-project-member] Enqueued Resource ID: b514e7fa-b164-4fff-a17b-451d75fd92cc with Priority: HIGHEST for action security_group_rules [ 667.978252] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b514e7fa-b164-4fff-a17b-451d75fd92cc with Priority: HIGHEST for action security_group_rules [ 667.978607] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b514e7fa-b164-4fff-a17b-451d75fd92cc taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.978747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b514e7fa-b164-4fff-a17b-451d75fd92cc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.978831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b514e7fa-b164-4fff-a17b-451d75fd92cc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.986997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b514e7fa-b164-4fff-a17b-451d75fd92cc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.986997] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b514e7fa-b164-4fff-a17b-451d75fd92cc',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.515724] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.519267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.519267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.519621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.519621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.519692] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b514e7fa-b164-4fff-a17b-451d75fd92cc already deleted. [ 668.519819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b514e7fa-b164-4fff-a17b-451d75fd92cc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.750187] env[66519]: INFO networking_nsxv3.common.synchronization [req-10fc3b5f-de9c-4e22-a520-6cb499ccb130 req-b1ecfd3c-8907-4892-b131-86f790d41a9b tempest-MultipleCreateTestJSON-1661318798 tempest-MultipleCreateTestJSON-1661318798-project-member] Enqueued Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 668.750790] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 668.751140] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.751295] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.751359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.751652] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.751847] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.751942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.752011] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.752156] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.752268] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.752334] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.255711] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.255711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.255711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.255711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.255711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.257607] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.257607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.257607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.257607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.257607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.257607] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db already deleted. [ 669.257607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.302462] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-617 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.304055] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-617" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.304055] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-617" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.304055] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-617" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.304055] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.308068] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.308068] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.308068] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.308068] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.308068] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.308068] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.308068] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.308068] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.308068] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.308068] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.308068] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.346974] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.346974] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 669.346974] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.346974] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-617" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.346974] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-498a7b66-c5f9-421f-a195-bfa8e7f255df taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.346974] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-498a7b66-c5f9-421f-a195-bfa8e7f255df" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.346974] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-498a7b66-c5f9-421f-a195-bfa8e7f255df" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.346974] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-498a7b66-c5f9-421f-a195-bfa8e7f255df" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.346974] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('498a7b66-c5f9-421f-a195-bfa8e7f255df',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.689378] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6960f374-b898-4940-b626-d2d9b6819605 in Status: SUCCESS [ 669.689378] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6960f374-b898-4940-b626-d2d9b6819605 deletion is rescheduled due to dependency. [ 669.690252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6960f374-b898-4940-b626-d2d9b6819605" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.851182] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.851402] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.851523] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.851909] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.852067] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.852342] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 498a7b66-c5f9-421f-a195-bfa8e7f255df not found, creating... [ 669.852531] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.852691] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.852816] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.853095] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.853306] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.853527] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.853676] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.853783] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.853990] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.858273] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.858439] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 498a7b66-c5f9-421f-a195-bfa8e7f255df is going to be created. [ 669.881266] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.881506] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.881506] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.881773] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.882083] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.882335] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-498a7b66-c5f9-421f-a195-bfa8e7f255df" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.748441] env[66519]: INFO networking_nsxv3.common.synchronization [req-10fc3b5f-de9c-4e22-a520-6cb499ccb130 req-68f30af9-8e33-43c9-8a01-f63f8246099e service nova] Enqueued Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_rules [ 670.751105] env[66519]: INFO networking_nsxv3.common.synchronization [req-10fc3b5f-de9c-4e22-a520-6cb499ccb130 req-68f30af9-8e33-43c9-8a01-f63f8246099e service nova] Enqueued Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 670.751105] env[66519]: INFO networking_nsxv3.common.synchronization [req-10fc3b5f-de9c-4e22-a520-6cb499ccb130 req-68f30af9-8e33-43c9-8a01-f63f8246099e service nova] Enqueued Resource ID: 498a7b66-c5f9-421f-a195-bfa8e7f255df with Priority: HIGHEST for action port [ 670.751105] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_rules [ 670.751105] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 670.751329] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 498a7b66-c5f9-421f-a195-bfa8e7f255df with Priority: HIGHEST for action port [ 670.752078] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.752280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.752405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.753073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.753073] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.755797] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.756300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.756392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.756779] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.757970] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.757970] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.757970] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.757970] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.758180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.758237] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.760938] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-498a7b66-c5f9-421f-a195-bfa8e7f255df taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.761118] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-498a7b66-c5f9-421f-a195-bfa8e7f255df" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.761229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-498a7b66-c5f9-421f-a195-bfa8e7f255df" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.761371] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-498a7b66-c5f9-421f-a195-bfa8e7f255df" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.762101] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('498a7b66-c5f9-421f-a195-bfa8e7f255df',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.020780] env[66519]: INFO networking_nsxv3.common.synchronization [None req-e5645b5c-c1a5-4326-84ea-6d172a700fdb None None] Enqueued Resource ID: 218a084d-9e2d-4705-be62-523fed2fd1e9 with Priority: HIGHEST for action port [ 671.021631] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 218a084d-9e2d-4705-be62-523fed2fd1e9 with Priority: HIGHEST for action port [ 671.022046] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-218a084d-9e2d-4705-be62-523fed2fd1e9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.022187] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-218a084d-9e2d-4705-be62-523fed2fd1e9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.022256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-218a084d-9e2d-4705-be62-523fed2fd1e9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.022847] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-218a084d-9e2d-4705-be62-523fed2fd1e9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.022962] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('218a084d-9e2d-4705-be62-523fed2fd1e9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.263846] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.267681] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.267681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.267681] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 498a7b66-c5f9-421f-a195-bfa8e7f255df with status ACTIVE [ 671.267681] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.267681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.267681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.267681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.267681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.267681] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.267681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.267681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.267681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.267681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.267681] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.268800] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.268800] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.268800] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.268800] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.268800] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 498a7b66-c5f9-421f-a195-bfa8e7f255df is going to be updated. [ 671.290260] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.290260] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.290260] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.290571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.290571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.290739] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-498a7b66-c5f9-421f-a195-bfa8e7f255df" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.528956] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 218a084d-9e2d-4705-be62-523fed2fd1e9 [ 671.528956] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.528956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.528956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.528956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.528956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.528956] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:218a084d-9e2d-4705-be62-523fed2fd1e9 already deleted. [ 671.528956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-218a084d-9e2d-4705-be62-523fed2fd1e9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.770034] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.008127] env[66519]: INFO networking_nsxv3.common.synchronization [req-d2cd2c39-91ab-4f17-8a49-5e5e7b515238 req-90d451db-0b65-4b5c-9999-9034c597977f tempest-VolumesAdminNegativeTest-422292084 tempest-VolumesAdminNegativeTest-422292084-project-member] Enqueued Resource ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c with Priority: HIGHEST for action security_group_members [ 672.008729] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c with Priority: HIGHEST for action security_group_members [ 672.009264] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.009264] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.009426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.009607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.009772] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.009873] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.009988] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.010102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.010190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.010287] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc90b596-5915-4a67-a6d8-a20bd8cf9e3c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.275224] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.275224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.275224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.275224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.275224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.275224] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db is going to be created. [ 672.309397] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.309397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.309397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.309397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.309397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.324512] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: UNINITIALIZED for 2s [ 672.493122] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-342 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.493565] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-342" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.493752] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-342" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.494219] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-342" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.494664] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.494874] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.495060] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.495374] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.495574] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.495994] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.496097] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 672.496178] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 672.496360] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 672.496509] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.496686] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 672.496909] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 672.513369] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.513658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.513804] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.514395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.514549] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.514850] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.514986] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.515601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.515601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.515601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.515601] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c already deleted. [ 672.515812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.524663] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 672.524909] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 672.525235] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 672.525384] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-342" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.525817] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-1a0e379d-c5ae-4fc7-a17a-c89b2ce2ee1a taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.526122] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-1a0e379d-c5ae-4fc7-a17a-c89b2ce2ee1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.526293] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-1a0e379d-c5ae-4fc7-a17a-c89b2ce2ee1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.526736] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-1a0e379d-c5ae-4fc7-a17a-c89b2ce2ee1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.526911] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a0e379d-c5ae-4fc7-a17a-c89b2ce2ee1a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.945826] env[66519]: INFO networking_nsxv3.common.synchronization [None req-c3df5dbd-b983-4779-aa55-24ee28e7bc0a None None] Enqueued Resource ID: e662f9a7-6adc-4c09-a6b7-bb0e9145f181 with Priority: HIGHEST for action port [ 672.946447] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e662f9a7-6adc-4c09-a6b7-bb0e9145f181 with Priority: HIGHEST for action port [ 672.946762] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-e662f9a7-6adc-4c09-a6b7-bb0e9145f181 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.946889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e662f9a7-6adc-4c09-a6b7-bb0e9145f181" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.946948] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e662f9a7-6adc-4c09-a6b7-bb0e9145f181" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.951371] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e662f9a7-6adc-4c09-a6b7-bb0e9145f181" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.951434] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e662f9a7-6adc-4c09-a6b7-bb0e9145f181',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.030034] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.030275] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.030455] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.030832] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.030993] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.031156] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 1a0e379d-c5ae-4fc7-a17a-c89b2ce2ee1a not found, creating... [ 673.031417] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.031570] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.031680] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.031894] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.032034] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.032311] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.032459] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.032569] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.033008] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.033008] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.033122] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 1a0e379d-c5ae-4fc7-a17a-c89b2ce2ee1a is going to be created. [ 673.060785] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.060785] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.060785] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.061145] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.061440] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.061792] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-1a0e379d-c5ae-4fc7-a17a-c89b2ce2ee1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.454067] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e662f9a7-6adc-4c09-a6b7-bb0e9145f181 [ 673.454364] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.454554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.454669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.454971] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.455194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.455322] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e662f9a7-6adc-4c09-a6b7-bb0e9145f181 already deleted. [ 673.455464] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e662f9a7-6adc-4c09-a6b7-bb0e9145f181" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.597158] env[66519]: INFO networking_nsxv3.common.synchronization [None req-891d5102-889c-4b91-b1e3-a56d29d03eb1 None None] Enqueued Resource ID: 49bd074f-c0fd-48ef-b61c-69769084e42c with Priority: HIGHEST for action port [ 673.598735] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49bd074f-c0fd-48ef-b61c-69769084e42c with Priority: HIGHEST for action port [ 673.598735] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-49bd074f-c0fd-48ef-b61c-69769084e42c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.598735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49bd074f-c0fd-48ef-b61c-69769084e42c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.598735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49bd074f-c0fd-48ef-b61c-69769084e42c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.598735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49bd074f-c0fd-48ef-b61c-69769084e42c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.599286] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49bd074f-c0fd-48ef-b61c-69769084e42c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.817878] env[66519]: INFO networking_nsxv3.common.synchronization [req-d2cd2c39-91ab-4f17-8a49-5e5e7b515238 req-cf274e27-8274-48c0-9a72-4451553ab7e5 service nova] Enqueued Resource ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c with Priority: HIGHEST for action security_group_rules [ 673.818503] env[66519]: INFO networking_nsxv3.common.synchronization [req-d2cd2c39-91ab-4f17-8a49-5e5e7b515238 req-cf274e27-8274-48c0-9a72-4451553ab7e5 service nova] Enqueued Resource ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c with Priority: HIGHEST for action security_group_members [ 673.818601] env[66519]: INFO networking_nsxv3.common.synchronization [req-d2cd2c39-91ab-4f17-8a49-5e5e7b515238 req-cf274e27-8274-48c0-9a72-4451553ab7e5 service nova] Enqueued Resource ID: 1a0e379d-c5ae-4fc7-a17a-c89b2ce2ee1a with Priority: HIGHEST for action port [ 673.819489] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c with Priority: HIGHEST for action security_group_rules [ 673.819489] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c with Priority: HIGHEST for action security_group_members [ 673.819489] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a0e379d-c5ae-4fc7-a17a-c89b2ce2ee1a with Priority: HIGHEST for action port [ 673.819699] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.819967] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.819967] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.820872] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.820872] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc90b596-5915-4a67-a6d8-a20bd8cf9e3c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.821631] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.821748] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.821818] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.823600] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.824968] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.825132] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.825212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.825433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.825613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.825613] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc90b596-5915-4a67-a6d8-a20bd8cf9e3c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.826735] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a0e379d-c5ae-4fc7-a17a-c89b2ce2ee1a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.826863] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a0e379d-c5ae-4fc7-a17a-c89b2ce2ee1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.826941] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a0e379d-c5ae-4fc7-a17a-c89b2ce2ee1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.827214] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a0e379d-c5ae-4fc7-a17a-c89b2ce2ee1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.827288] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a0e379d-c5ae-4fc7-a17a-c89b2ce2ee1a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.106831] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49bd074f-c0fd-48ef-b61c-69769084e42c [ 674.107302] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.108685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.109958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.109958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.109958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.109958] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49bd074f-c0fd-48ef-b61c-69769084e42c already deleted. [ 674.109958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49bd074f-c0fd-48ef-b61c-69769084e42c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.333655] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc90b596-5915-4a67-a6d8-a20bd8cf9e3c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.334593] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.334758] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.334838] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a0e379d-c5ae-4fc7-a17a-c89b2ce2ee1a with status ACTIVE [ 674.335092] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.335181] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.335329] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.335493] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.335583] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.335772] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.335874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.336229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.336229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.336229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.336445] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.336501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.336537] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.336712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.336885] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.336885] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a0e379d-c5ae-4fc7-a17a-c89b2ce2ee1a is going to be updated. [ 674.341703] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: SUCCESS [ 674.344173] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.344378] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.344611] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.344818] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.344948] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.345024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.345238] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.345349] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.345471] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.345592] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.364990] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.364990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.364990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.364990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.364990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.365936] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a0e379d-c5ae-4fc7-a17a-c89b2ce2ee1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.703687] env[66519]: INFO networking_nsxv3.common.synchronization [req-10fc3b5f-de9c-4e22-a520-6cb499ccb130 req-8e5d8f19-d068-4d80-ac65-8bbde511b993 tempest-MultipleCreateTestJSON-1661318798 tempest-MultipleCreateTestJSON-1661318798-project-member] Enqueued Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 674.704298] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 674.704624] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.704797] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.705364] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.705618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.705828] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.705905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.705972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.706248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.706376] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.706450] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.839714] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc90b596-5915-4a67-a6d8-a20bd8cf9e3c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.852689] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.852925] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.161603] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-617 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.161966] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-617" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.162024] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-617" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.162475] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-617" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.162576] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.162659] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.162785] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.163070] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.163217] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.163442] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.163545] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.163646] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.163747] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.163848] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.163946] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.164081] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.183308] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.183542] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 675.183760] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.183996] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-617" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.185042] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-ccf49c8b-aa58-4589-bb95-63e672627171 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.185042] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-ccf49c8b-aa58-4589-bb95-63e672627171" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.185042] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-ccf49c8b-aa58-4589-bb95-63e672627171" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.185360] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-ccf49c8b-aa58-4589-bb95-63e672627171" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.185490] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccf49c8b-aa58-4589-bb95-63e672627171',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.209150] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.342655] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.342874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.342874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.343271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.343414] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.343534] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c is going to be created. [ 675.370905] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.371238] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.371238] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.371463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.371622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.383233] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c in Status: UNINITIALIZED for 2s [ 675.689034] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.689034] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.689214] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.689403] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.689577] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.689694] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port ccf49c8b-aa58-4589-bb95-63e672627171 not found, creating... [ 675.689955] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.690153] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.691619] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.691950] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.692088] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.692736] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.692845] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.692973] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.693462] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.693462] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.693608] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: ccf49c8b-aa58-4589-bb95-63e672627171 is going to be created. [ 675.711149] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.719819] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.719819] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.719819] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.719819] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.719819] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.719819] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-ccf49c8b-aa58-4589-bb95-63e672627171" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.215615] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.215867] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.215962] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.217359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.217488] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.217628] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db is going to be updated. [ 676.251731] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.251958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.251958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.252205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.252333] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.262410] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: IN_PROGRESS for 2s [ 676.312747] env[66519]: INFO networking_nsxv3.common.synchronization [None req-2692c2e7-21ab-44b0-aa7e-bbb5432c2ca2 None None] Enqueued Resource ID: a1a9e265-d7ae-4f50-b8c2-b26be7cda0f3 with Priority: HIGHEST for action port [ 676.313320] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1a9e265-d7ae-4f50-b8c2-b26be7cda0f3 with Priority: HIGHEST for action port [ 676.314464] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1a9e265-d7ae-4f50-b8c2-b26be7cda0f3 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.314464] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1a9e265-d7ae-4f50-b8c2-b26be7cda0f3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.314464] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1a9e265-d7ae-4f50-b8c2-b26be7cda0f3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.314464] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1a9e265-d7ae-4f50-b8c2-b26be7cda0f3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.314713] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1a9e265-d7ae-4f50-b8c2-b26be7cda0f3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.568144] env[66519]: INFO networking_nsxv3.common.synchronization [req-10fc3b5f-de9c-4e22-a520-6cb499ccb130 req-0b3ec143-5549-4ec4-8e42-269e409cd2ee service nova] Enqueued Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_rules [ 676.568361] env[66519]: INFO networking_nsxv3.common.synchronization [req-10fc3b5f-de9c-4e22-a520-6cb499ccb130 req-0b3ec143-5549-4ec4-8e42-269e409cd2ee service nova] Enqueued Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 676.568824] env[66519]: INFO networking_nsxv3.common.synchronization [req-10fc3b5f-de9c-4e22-a520-6cb499ccb130 req-0b3ec143-5549-4ec4-8e42-269e409cd2ee service nova] Enqueued Resource ID: ccf49c8b-aa58-4589-bb95-63e672627171 with Priority: HIGHEST for action port [ 676.569384] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_rules [ 676.569528] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 676.569691] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccf49c8b-aa58-4589-bb95-63e672627171 with Priority: HIGHEST for action port [ 676.570063] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.570199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.570419] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.570512] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.570694] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccf49c8b-aa58-4589-bb95-63e672627171 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.570816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccf49c8b-aa58-4589-bb95-63e672627171" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.570871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccf49c8b-aa58-4589-bb95-63e672627171" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.571160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccf49c8b-aa58-4589-bb95-63e672627171" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.571231] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccf49c8b-aa58-4589-bb95-63e672627171',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.816932] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1a9e265-d7ae-4f50-b8c2-b26be7cda0f3 [ 676.817425] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.818198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.818424] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.819078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.819196] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.819327] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1a9e265-d7ae-4f50-b8c2-b26be7cda0f3 already deleted. [ 676.819417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1a9e265-d7ae-4f50-b8c2-b26be7cda0f3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.078032] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ccf49c8b-aa58-4589-bb95-63e672627171 with status ACTIVE [ 677.078032] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.078032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.078032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.078032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.078032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.078032] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.078032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.078032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.078032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.078032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.078032] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.078032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.078032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.078032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.078032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.078032] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ccf49c8b-aa58-4589-bb95-63e672627171 is going to be updated. [ 677.101800] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.101956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.102040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.102269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.102435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.102610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccf49c8b-aa58-4589-bb95-63e672627171" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.394408] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c in Status: SUCCESS [ 677.394764] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.394883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.395237] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.395484] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.395637] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.395739] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.395953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.396081] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.396207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.396270] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc90b596-5915-4a67-a6d8-a20bd8cf9e3c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.898565] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.898843] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.898843] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.899134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.899342] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.899482] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.899637] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.900166] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.900289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.900403] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.900585] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.900983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.900983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.900983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.901225] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.901379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.901379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.902032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.902032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.902032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.902032] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc90b596-5915-4a67-a6d8-a20bd8cf9e3c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.927567] env[66519]: INFO networking_nsxv3.common.synchronization [None req-30a84313-cfe5-4068-8786-3f0e8452fd66 tempest-AttachVolumeShelveTestJSON-264753527 tempest-AttachVolumeShelveTestJSON-264753527-project-member] Enqueued Resource ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 with Priority: HIGHEST for action security_group_rules [ 677.928305] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 with Priority: HIGHEST for action security_group_rules [ 677.928604] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.928715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.928781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.930269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.930269] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb3bbf89-6cbf-4b9e-b793-607035a2d9c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.176189] env[66519]: INFO networking_nsxv3.common.synchronization [None req-23b8822a-7a2e-4643-b257-04fc3e04d44a tempest-AttachVolumeShelveTestJSON-264753527 tempest-AttachVolumeShelveTestJSON-264753527-project-member] Enqueued Resource ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 with Priority: HIGHEST for action security_group_rules [ 678.176189] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 with Priority: HIGHEST for action security_group_rules [ 678.176189] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.176189] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.272965] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: SUCCESS [ 678.273203] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.273416] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.273622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.273825] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.274456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.274456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.274456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.274456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.274456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.274701] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.274701] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.274784] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.274978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.275131] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.275262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.275350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.275473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.275541] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.275666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.275727] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.276753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.277382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.277382] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.277382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.277382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.277669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.277669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.277669] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.404640] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc90b596-5915-4a67-a6d8-a20bd8cf9e3c: rpc.has_security_group_logging(os_id): False [ 678.425056] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.425056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.425056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.425370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.425370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.425601] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.425719] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.425784] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.425982] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.426233] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.426354] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.426544] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.426544] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.426684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.426801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.426948] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.427072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.427138] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.427321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.427412] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.427656] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c is going to be created. [ 678.448346] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.448346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.448346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.448346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.448346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.448346] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 already deleted. [ 678.448346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.448346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.449516] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.449516] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb3bbf89-6cbf-4b9e-b793-607035a2d9c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.494857] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.494857] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.495099] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.495186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.495439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.510463] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c in Status: IN_PROGRESS for 2s [ 678.779642] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85cd9d13-e10b-45af-9c04-2923bcfe37db: rpc.has_security_group_logging(os_id): False [ 678.780805] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.800214] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.800525] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.800627] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.800806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.800894] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.801102] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.801448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.801448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.801448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.801552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.801738] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.801844] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.801902] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.802156] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.802305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.802461] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.802552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.802871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.802871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.802871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.802871] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db is going to be created. [ 678.847213] env[66519]: INFO networking_nsxv3.common.synchronization [None req-c8770139-2977-4a9d-aa65-c1c8f4b80c09 None None] Enqueued Resource ID: 4efc5d9a-9914-40f8-9db7-5d6edece9388 with Priority: HIGHEST for action port [ 678.847213] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4efc5d9a-9914-40f8-9db7-5d6edece9388 with Priority: HIGHEST for action port [ 678.847213] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-4efc5d9a-9914-40f8-9db7-5d6edece9388 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.847213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4efc5d9a-9914-40f8-9db7-5d6edece9388" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.847213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4efc5d9a-9914-40f8-9db7-5d6edece9388" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.847866] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4efc5d9a-9914-40f8-9db7-5d6edece9388" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.848207] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4efc5d9a-9914-40f8-9db7-5d6edece9388',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.866552] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.866726] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.866726] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.868119] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.868119] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.879376] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: IN_PROGRESS for 2s [ 678.974370] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.974370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.974370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.974370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.974370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.974370] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 already deleted. [ 678.974370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.282817] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.350783] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4efc5d9a-9914-40f8-9db7-5d6edece9388 [ 679.351740] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.351963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.352204] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.352365] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.352558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.352704] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4efc5d9a-9914-40f8-9db7-5d6edece9388 already deleted. [ 679.352828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4efc5d9a-9914-40f8-9db7-5d6edece9388" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.490511] env[66519]: INFO networking_nsxv3.common.synchronization [req-5aa27d63-44ab-4bd8-8ff9-8c6d3acff47f req-e8cd3ac6-6074-42fd-b401-c84dc6de1262 tempest-ServersAdminNegativeTestJSON-1811417065 tempest-ServersAdminNegativeTestJSON-1811417065-project-member] Enqueued Resource ID: 820ceacd-99d3-4034-aaf8-315de338869a with Priority: HIGHEST for action security_group_members [ 679.491060] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820ceacd-99d3-4034-aaf8-315de338869a with Priority: HIGHEST for action security_group_members [ 679.491364] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-820ceacd-99d3-4034-aaf8-315de338869a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.491500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.491564] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.496290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.496482] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.496604] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.496668] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.496863] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.496937] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.497044] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.786694] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.786694] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.786694] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.786694] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.786694] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.786694] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db is going to be updated. [ 679.823053] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.823053] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.823053] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.823362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.823496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.839519] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: IN_PROGRESS for 2s [ 680.007545] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.028791] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.028791] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.028791] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.028791] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.028791] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.029186] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.029186] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.029416] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.029416] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.033047] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.033047] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.033047] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.033047] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.033047] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.033047] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.033047] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.060633] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.061344] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 680.061344] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.061344] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.061601] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-448ec914-a13b-4399-ba50-18eaefbb0647 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.061882] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-448ec914-a13b-4399-ba50-18eaefbb0647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.063508] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-448ec914-a13b-4399-ba50-18eaefbb0647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.066546] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-448ec914-a13b-4399-ba50-18eaefbb0647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.066546] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('448ec914-a13b-4399-ba50-18eaefbb0647',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.510498] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.526109] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c in Status: SUCCESS [ 680.526109] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.569908] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.570340] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.574182] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.574561] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.574705] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.575573] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 448ec914-a13b-4399-ba50-18eaefbb0647 not found, creating... [ 680.575573] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.575573] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.575573] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.577545] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.577545] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.577545] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.577545] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.577545] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.577545] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.577545] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.577545] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 448ec914-a13b-4399-ba50-18eaefbb0647 is going to be created. [ 680.614378] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.614378] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.614378] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.614851] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.615166] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.615408] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-448ec914-a13b-4399-ba50-18eaefbb0647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.895043] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: SUCCESS [ 680.895394] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.895631] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.895931] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.896062] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.919466] env[66519]: INFO networking_nsxv3.common.synchronization [None req-be51416f-35e8-4324-a63f-c7705f0fd1af None None] Enqueued Resource ID: e24b7c83-d638-4d8b-885e-c5a85a8d5ee3 with Priority: HIGHEST for action port [ 680.920327] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24b7c83-d638-4d8b-885e-c5a85a8d5ee3 with Priority: HIGHEST for action port [ 680.920581] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-e24b7c83-d638-4d8b-885e-c5a85a8d5ee3 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.920652] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e24b7c83-d638-4d8b-885e-c5a85a8d5ee3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.920716] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e24b7c83-d638-4d8b-885e-c5a85a8d5ee3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.921423] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e24b7c83-d638-4d8b-885e-c5a85a8d5ee3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.921562] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e24b7c83-d638-4d8b-885e-c5a85a8d5ee3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.013691] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.014402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.014532] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.014707] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.014792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.014893] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 820ceacd-99d3-4034-aaf8-315de338869a is going to be updated. [ 681.050091] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.050396] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.050396] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.050560] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.050651] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.061578] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820ceacd-99d3-4034-aaf8-315de338869a in Status: IN_PROGRESS for 2s [ 681.309985] env[66519]: INFO networking_nsxv3.common.synchronization [req-5aa27d63-44ab-4bd8-8ff9-8c6d3acff47f req-e707fba1-276d-4183-a719-476db2c3834a service nova] Enqueued Resource ID: 820ceacd-99d3-4034-aaf8-315de338869a with Priority: HIGHEST for action security_group_rules [ 681.309985] env[66519]: INFO networking_nsxv3.common.synchronization [req-5aa27d63-44ab-4bd8-8ff9-8c6d3acff47f req-e707fba1-276d-4183-a719-476db2c3834a service nova] Enqueued Resource ID: 820ceacd-99d3-4034-aaf8-315de338869a with Priority: HIGHEST for action security_group_members [ 681.310213] env[66519]: INFO networking_nsxv3.common.synchronization [req-5aa27d63-44ab-4bd8-8ff9-8c6d3acff47f req-e707fba1-276d-4183-a719-476db2c3834a service nova] Enqueued Resource ID: 448ec914-a13b-4399-ba50-18eaefbb0647 with Priority: HIGHEST for action port [ 681.310612] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820ceacd-99d3-4034-aaf8-315de338869a with Priority: HIGHEST for action security_group_rules [ 681.312338] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820ceacd-99d3-4034-aaf8-315de338869a with Priority: HIGHEST for action security_group_members [ 681.312338] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 448ec914-a13b-4399-ba50-18eaefbb0647 with Priority: HIGHEST for action port [ 681.312338] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-820ceacd-99d3-4034-aaf8-315de338869a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.312338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.312338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.312338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.312338] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.313348] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-820ceacd-99d3-4034-aaf8-315de338869a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.317023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.317023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-448ec914-a13b-4399-ba50-18eaefbb0647 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.317023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-448ec914-a13b-4399-ba50-18eaefbb0647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.317023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-448ec914-a13b-4399-ba50-18eaefbb0647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.317023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-448ec914-a13b-4399-ba50-18eaefbb0647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.317023] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('448ec914-a13b-4399-ba50-18eaefbb0647',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.399503] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.399638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.424756] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e24b7c83-d638-4d8b-885e-c5a85a8d5ee3 [ 681.424909] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.425136] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.425136] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.425831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.425831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.425831] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e24b7c83-d638-4d8b-885e-c5a85a8d5ee3 already deleted. [ 681.425831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e24b7c83-d638-4d8b-885e-c5a85a8d5ee3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.816817] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 448ec914-a13b-4399-ba50-18eaefbb0647 with status ACTIVE [ 681.817515] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.817515] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.818840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.819112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.819216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.819425] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.819528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.819588] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.819754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.819828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.820016] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.820118] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.820177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.820318] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.820382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.820463] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 448ec914-a13b-4399-ba50-18eaefbb0647 is going to be updated. [ 681.822038] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-820ceacd-99d3-4034-aaf8-315de338869a taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.822287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.855233] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: SUCCESS [ 681.855464] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.855757] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.855849] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.856062] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.856172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.856242] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.856396] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.856522] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.856565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.856667] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.860980] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.860980] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.860980] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.861343] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.862629] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.863127] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-448ec914-a13b-4399-ba50-18eaefbb0647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.371128] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.371128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.371128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.371128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.371128] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.371128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.371128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.371128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.371128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.371128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.371128] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.372102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.372421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.373118] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.373118] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.373118] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.374099] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.374099] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.374099] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.374099] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.374099] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.876874] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85cd9d13-e10b-45af-9c04-2923bcfe37db: rpc.has_security_group_logging(os_id): False [ 682.903122] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.903122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.903122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.903442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.903566] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.905370] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.905370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.905370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.905370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.905370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.905370] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.905370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.905370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.905370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.905370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.905370] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.905956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.905956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.905956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.905956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.905956] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db is going to be updated. [ 682.988577] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.988724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.988778] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.988985] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.990047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.004538] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: IN_PROGRESS for 2s [ 683.079882] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820ceacd-99d3-4034-aaf8-315de338869a in Status: SUCCESS [ 683.080218] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.080404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.081354] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.081625] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.081758] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.081823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.081997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.082102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.082211] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.094761] env[66519]: INFO networking_nsxv3.common.synchronization [None req-03ebbc0f-16c3-4b50-8676-052a03682d66 None None] Enqueued Resource ID: 9c9b4aa3-a2c8-477b-8634-9f61765037b0 with Priority: HIGHEST for action port [ 683.095811] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c9b4aa3-a2c8-477b-8634-9f61765037b0 with Priority: HIGHEST for action port [ 683.096975] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c9b4aa3-a2c8-477b-8634-9f61765037b0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.096975] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c9b4aa3-a2c8-477b-8634-9f61765037b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.096975] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c9b4aa3-a2c8-477b-8634-9f61765037b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.097297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c9b4aa3-a2c8-477b-8634-9f61765037b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.097297] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c9b4aa3-a2c8-477b-8634-9f61765037b0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.588926] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.602106] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c9b4aa3-a2c8-477b-8634-9f61765037b0 [ 683.603289] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.603289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.603289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.603289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.603289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.603289] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c9b4aa3-a2c8-477b-8634-9f61765037b0 already deleted. [ 683.603289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c9b4aa3-a2c8-477b-8634-9f61765037b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.787316] env[66519]: INFO networking_nsxv3.common.synchronization [None req-92dc2fe6-d647-4702-b9ec-edb9139c145e None None] Enqueued Resource ID: 5585b36b-264a-4af3-9522-ca2cc7d644ba with Priority: HIGHEST for action port [ 683.787316] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5585b36b-264a-4af3-9522-ca2cc7d644ba with Priority: HIGHEST for action port [ 683.787316] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-5585b36b-264a-4af3-9522-ca2cc7d644ba taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.787316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5585b36b-264a-4af3-9522-ca2cc7d644ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.787316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5585b36b-264a-4af3-9522-ca2cc7d644ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.787790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5585b36b-264a-4af3-9522-ca2cc7d644ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.787946] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5585b36b-264a-4af3-9522-ca2cc7d644ba',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.094532] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.280176] env[66519]: INFO networking_nsxv3.common.synchronization [req-74415ee4-b705-4c60-897f-517663603e56 req-1ec079fd-2709-4d1a-8ebd-31984caeaf0e tempest-ServerDiagnosticsTest-2133965350 tempest-ServerDiagnosticsTest-2133965350-project-member] Enqueued Resource ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a with Priority: HIGHEST for action security_group_members [ 684.282387] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a with Priority: HIGHEST for action security_group_members [ 684.282850] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.283069] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.283194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.284623] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.284799] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.284913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.284962] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.285172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.285261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.285420] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc7e1373-9ebc-4cc6-b80c-fa60c152026a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.291281] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5585b36b-264a-4af3-9522-ca2cc7d644ba [ 684.291281] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.291512] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.291606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.292030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.292186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.292290] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5585b36b-264a-4af3-9522-ca2cc7d644ba already deleted. [ 684.292845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5585b36b-264a-4af3-9522-ca2cc7d644ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.492424] env[66519]: INFO networking_nsxv3.common.synchronization [req-6de3a9c1-45e0-41c1-9658-f43bfa080494 req-09054558-8e5a-444a-aee4-f1aa7f9e8ffa tempest-ServersNegativeTestJSON-375310877 tempest-ServersNegativeTestJSON-375310877-project-member] Enqueued Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_members [ 684.493551] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_members [ 684.494389] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.494389] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.494389] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.495273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.495894] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.496033] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.496429] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.496429] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.496429] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.496563] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.598452] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.599816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.602040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.602040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.602040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.602040] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 820ceacd-99d3-4034-aaf8-315de338869a is going to be updated. [ 684.645453] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.645605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.645684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.647802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.647802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.662243] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820ceacd-99d3-4034-aaf8-315de338869a in Status: IN_PROGRESS for 2s [ 684.788579] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.789514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.789688] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.789930] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.792023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.792023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.792023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.792023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.792023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.792023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.792023] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a is going to be updated. [ 684.827598] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.827839] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.827839] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.828054] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.828200] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.844249] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a in Status: IN_PROGRESS for 2s [ 685.000197] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.000374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.000446] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.001305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.001305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.001305] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.001305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.001305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.001305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.002063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.002063] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f825e83f-7046-4bbd-969b-a037ace80c92 already deleted. [ 685.002063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.018024] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: SUCCESS [ 685.018247] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.842056] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.842403] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-887" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.842476] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-887" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.843054] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-887" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.843054] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.843236] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.843296] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.843488] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.843625] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.843826] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.843932] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.844046] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.844178] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.844311] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.844470] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.844609] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.865936] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.866103] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 685.866268] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.866468] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-887" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.866857] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-e5ced596-1881-43b1-b3d3-59261afdf0e7 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.867049] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-e5ced596-1881-43b1-b3d3-59261afdf0e7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.867164] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-e5ced596-1881-43b1-b3d3-59261afdf0e7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.867468] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-e5ced596-1881-43b1-b3d3-59261afdf0e7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.869454] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5ced596-1881-43b1-b3d3-59261afdf0e7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.373026] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.373026] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.373026] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.373026] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.373026] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.373026] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port e5ced596-1881-43b1-b3d3-59261afdf0e7 not found, creating... [ 686.373026] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.373026] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.373026] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.373026] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.373026] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.373639] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.373639] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.373639] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.373639] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.373639] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.373639] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: e5ced596-1881-43b1-b3d3-59261afdf0e7 is going to be created. [ 686.396797] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.396797] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.396797] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.396797] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.396797] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.396797] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-e5ced596-1881-43b1-b3d3-59261afdf0e7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.673503] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820ceacd-99d3-4034-aaf8-315de338869a in Status: SUCCESS [ 686.673711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.673883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.674140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.674309] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.674421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.674488] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.674663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.674755] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.674841] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.674935] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.854636] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a in Status: SUCCESS [ 686.854969] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a deletion is rescheduled due to dependency. [ 686.854969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.177573] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-820ceacd-99d3-4034-aaf8-315de338869a taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.178370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.178370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.178648] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.178891] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.178891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.179021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.179959] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.179959] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.180094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.180297] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-820ceacd-99d3-4034-aaf8-315de338869a taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.180401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.180401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.180552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.180801] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.180801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.180927] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.181213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.181261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.181343] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.181527] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.237726] env[66519]: INFO networking_nsxv3.common.synchronization [req-6de3a9c1-45e0-41c1-9658-f43bfa080494 req-59470e83-0c2e-4aef-ba68-0643af49e976 service nova] Enqueued Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_rules [ 687.237981] env[66519]: INFO networking_nsxv3.common.synchronization [req-6de3a9c1-45e0-41c1-9658-f43bfa080494 req-59470e83-0c2e-4aef-ba68-0643af49e976 service nova] Enqueued Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_members [ 687.238163] env[66519]: INFO networking_nsxv3.common.synchronization [req-6de3a9c1-45e0-41c1-9658-f43bfa080494 req-59470e83-0c2e-4aef-ba68-0643af49e976 service nova] Enqueued Resource ID: e5ced596-1881-43b1-b3d3-59261afdf0e7 with Priority: HIGHEST for action port [ 687.238996] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_rules [ 687.239623] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_members [ 687.239770] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5ced596-1881-43b1-b3d3-59261afdf0e7 with Priority: HIGHEST for action port [ 687.240241] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.240476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.240578] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.240905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.241091] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.242229] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.242996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.243424] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.243680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.243933] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.244104] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.244201] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.244397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.244549] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.244691] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.245687] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5ced596-1881-43b1-b3d3-59261afdf0e7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.246017] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5ced596-1881-43b1-b3d3-59261afdf0e7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.246190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5ced596-1881-43b1-b3d3-59261afdf0e7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.246391] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5ced596-1881-43b1-b3d3-59261afdf0e7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.246515] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5ced596-1881-43b1-b3d3-59261afdf0e7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.683949] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 820ceacd-99d3-4034-aaf8-315de338869a: rpc.has_security_group_logging(os_id): False [ 687.703141] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.703289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.703362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.703580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.703674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.703883] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.703984] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.704121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.704457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.704457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.704527] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.704603] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.704641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.704782] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.704856] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.705366] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.705529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.705618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.705790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.705901] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.706019] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 820ceacd-99d3-4034-aaf8-315de338869a is going to be updated. [ 687.711119] env[66519]: INFO networking_nsxv3.common.synchronization [None req-c474a5b6-d069-4001-9a36-ece2c573a384 None None] Enqueued Resource ID: fa2f3d67-120c-4950-9d39-7311722979d9 with Priority: HIGHEST for action port [ 687.711705] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa2f3d67-120c-4950-9d39-7311722979d9 with Priority: HIGHEST for action port [ 687.712277] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa2f3d67-120c-4950-9d39-7311722979d9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.712426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa2f3d67-120c-4950-9d39-7311722979d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.712520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa2f3d67-120c-4950-9d39-7311722979d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.712794] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa2f3d67-120c-4950-9d39-7311722979d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.712909] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa2f3d67-120c-4950-9d39-7311722979d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.749948] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.750130] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.750451] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.751258] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5ced596-1881-43b1-b3d3-59261afdf0e7 with status ACTIVE [ 687.751430] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.751584] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.751642] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.751841] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.751933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.752131] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.752217] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.752285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.752433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.752535] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.752783] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.752924] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.753034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.753821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.753932] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.754064] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5ced596-1881-43b1-b3d3-59261afdf0e7 is going to be updated. [ 687.780423] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.780423] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.780524] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.781026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.781026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.781026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5ced596-1881-43b1-b3d3-59261afdf0e7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.785794] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.785914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.785914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.786749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.786749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.800608] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 820ceacd-99d3-4034-aaf8-315de338869a in Status: IN_PROGRESS for 2s [ 688.215101] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa2f3d67-120c-4950-9d39-7311722979d9 [ 688.216619] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.216619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.216619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.216619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.216619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.216619] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa2f3d67-120c-4950-9d39-7311722979d9 already deleted. [ 688.216619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa2f3d67-120c-4950-9d39-7311722979d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.258796] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.259400] env[66519]: INFO networking_nsxv3.common.synchronization [None req-1fb1c5f4-7b49-4d9b-9adb-d83672b39273 None None] Enqueued Resource ID: d1c2219a-2d9b-40fd-af3d-af3528dcc469 with Priority: HIGHEST for action port [ 688.260319] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1c2219a-2d9b-40fd-af3d-af3528dcc469 with Priority: HIGHEST for action port [ 688.260782] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1c2219a-2d9b-40fd-af3d-af3528dcc469 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.261035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1c2219a-2d9b-40fd-af3d-af3528dcc469" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.262061] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1c2219a-2d9b-40fd-af3d-af3528dcc469" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.262494] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1c2219a-2d9b-40fd-af3d-af3528dcc469" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.262852] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1c2219a-2d9b-40fd-af3d-af3528dcc469',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.762512] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.763024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.763152] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.764018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.764018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.764018] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f825e83f-7046-4bbd-969b-a037ace80c92 is going to be created. [ 688.765760] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1c2219a-2d9b-40fd-af3d-af3528dcc469 [ 688.766046] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.766237] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.766327] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.766612] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.766738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.766858] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1c2219a-2d9b-40fd-af3d-af3528dcc469 already deleted. [ 688.766962] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1c2219a-2d9b-40fd-af3d-af3528dcc469" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.795881] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.795881] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.795881] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.796221] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.796860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.810843] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: UNINITIALIZED for 2s [ 689.264590] env[66519]: INFO networking_nsxv3.common.synchronization [req-9f3fbb6d-6de1-4c6c-bc35-507224f082be req-fda06afb-dc3d-4511-99e5-9ee7beab327f tempest-ServerActionsV293TestJSON-1719924090 tempest-ServerActionsV293TestJSON-1719924090-project-member] Enqueued Resource ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a with Priority: HIGHEST for action security_group_members [ 689.265339] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a with Priority: HIGHEST for action security_group_members [ 689.267692] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.267901] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.268034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.268499] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.268719] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.268866] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.270632] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.270994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.271249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.271448] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94ea0731-22a6-40ee-a699-ef5f6ebe0f3a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.775585] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.775907] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.776169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.776437] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.776597] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.776938] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.777179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.777268] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.777570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.777712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.777855] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a already deleted. [ 689.777994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.822065] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 820ceacd-99d3-4034-aaf8-315de338869a in Status: SUCCESS [ 689.823805] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.883572] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-641 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.883572] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-641" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.883572] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-641" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.883572] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-641" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.884847] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.886263] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.886623] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.887465] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.889033] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.889033] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 689.889195] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 689.889345] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 689.889475] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 689.889622] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 689.889757] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 689.889915] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 689.911296] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 689.911476] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 689.911645] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 689.912106] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-641" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.912206] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-a8c2e531-66aa-47de-862d-788d431fddf4 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.912365] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-a8c2e531-66aa-47de-862d-788d431fddf4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.912487] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-a8c2e531-66aa-47de-862d-788d431fddf4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.912882] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-a8c2e531-66aa-47de-862d-788d431fddf4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.912919] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8c2e531-66aa-47de-862d-788d431fddf4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.417296] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.417296] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.417296] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.417628] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.417628] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.417716] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port a8c2e531-66aa-47de-862d-788d431fddf4 not found, creating... [ 690.417961] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.418419] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.418419] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.418419] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.418565] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.419541] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.419541] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.419541] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.419541] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.419541] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.419794] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: a8c2e531-66aa-47de-862d-788d431fddf4 is going to be created. [ 690.454371] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.454371] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.454371] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.454371] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.454371] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.454371] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-a8c2e531-66aa-47de-862d-788d431fddf4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.606542] env[66519]: INFO networking_nsxv3.common.synchronization [None req-fdec1fc1-a3c6-4f42-a5d2-1fca998b2a40 None None] Enqueued Resource ID: a132e182-450a-4092-8609-25053b388ad7 with Priority: HIGHEST for action port [ 690.607268] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a132e182-450a-4092-8609-25053b388ad7 with Priority: HIGHEST for action port [ 690.608221] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-a132e182-450a-4092-8609-25053b388ad7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.608221] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a132e182-450a-4092-8609-25053b388ad7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.608221] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a132e182-450a-4092-8609-25053b388ad7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.608221] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a132e182-450a-4092-8609-25053b388ad7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.608221] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a132e182-450a-4092-8609-25053b388ad7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.823134] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: SUCCESS [ 690.823798] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.823984] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.824284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.824534] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.824659] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.824741] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.824944] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.825078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.825221] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.825331] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.934137] env[66519]: INFO networking_nsxv3.common.synchronization [None req-e3fe84c0-d87c-4d38-8f37-f159812b7b5b None None] Enqueued Resource ID: 1e439d80-5301-472f-8404-c921034eba27 with Priority: HIGHEST for action port [ 690.934847] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e439d80-5301-472f-8404-c921034eba27 with Priority: HIGHEST for action port [ 690.936022] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e439d80-5301-472f-8404-c921034eba27 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.938281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e439d80-5301-472f-8404-c921034eba27" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.938427] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e439d80-5301-472f-8404-c921034eba27" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.938847] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e439d80-5301-472f-8404-c921034eba27" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.938982] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e439d80-5301-472f-8404-c921034eba27',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.111160] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a132e182-450a-4092-8609-25053b388ad7 [ 691.111774] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.111774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.111774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.111968] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.112142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.112196] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a132e182-450a-4092-8609-25053b388ad7 already deleted. [ 691.112297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a132e182-450a-4092-8609-25053b388ad7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.197790] env[66519]: INFO networking_nsxv3.common.synchronization [req-9f3fbb6d-6de1-4c6c-bc35-507224f082be req-d8e5afab-22a3-4486-ad12-f8ef6e702d28 service nova] Enqueued Resource ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a with Priority: HIGHEST for action security_group_rules [ 691.197979] env[66519]: INFO networking_nsxv3.common.synchronization [req-9f3fbb6d-6de1-4c6c-bc35-507224f082be req-d8e5afab-22a3-4486-ad12-f8ef6e702d28 service nova] Enqueued Resource ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a with Priority: HIGHEST for action security_group_members [ 691.198131] env[66519]: INFO networking_nsxv3.common.synchronization [req-9f3fbb6d-6de1-4c6c-bc35-507224f082be req-d8e5afab-22a3-4486-ad12-f8ef6e702d28 service nova] Enqueued Resource ID: a8c2e531-66aa-47de-862d-788d431fddf4 with Priority: HIGHEST for action port [ 691.198775] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a with Priority: HIGHEST for action security_group_rules [ 691.198909] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a with Priority: HIGHEST for action security_group_members [ 691.198994] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8c2e531-66aa-47de-862d-788d431fddf4 with Priority: HIGHEST for action port [ 691.200237] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.200413] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.200516] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.200744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.200887] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94ea0731-22a6-40ee-a699-ef5f6ebe0f3a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.202572] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.202710] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.202809] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.203195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.203443] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.203557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.203625] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.203851] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.203962] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.204070] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94ea0731-22a6-40ee-a699-ef5f6ebe0f3a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.205398] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8c2e531-66aa-47de-862d-788d431fddf4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.205539] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8c2e531-66aa-47de-862d-788d431fddf4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.205638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8c2e531-66aa-47de-862d-788d431fddf4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.205848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8c2e531-66aa-47de-862d-788d431fddf4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.205956] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8c2e531-66aa-47de-862d-788d431fddf4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.287310] env[66519]: INFO networking_nsxv3.common.synchronization [req-55a01717-0475-4dc3-b6e7-2a6a659d586d req-a351958f-7819-46b4-8434-93c069039d5b tempest-ServersTestMultiNic-666815749 tempest-ServersTestMultiNic-666815749-project-member] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 691.287950] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 691.289240] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.289405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.289574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.289814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.290037] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.290473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.290473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.290473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.290729] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.290759] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.331169] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.331169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.331169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.331169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.331169] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.331169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.331169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.331169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.331169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.331169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.331169] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.331169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.331169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.331169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.331169] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.331169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.331969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.332784] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.332888] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.332986] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.333121] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.445225] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e439d80-5301-472f-8404-c921034eba27 [ 691.445532] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.446121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.446121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.446121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.446248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.446425] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e439d80-5301-472f-8404-c921034eba27 already deleted. [ 691.446476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e439d80-5301-472f-8404-c921034eba27" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.710247] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.710247] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.710638] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94ea0731-22a6-40ee-a699-ef5f6ebe0f3a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.712182] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8c2e531-66aa-47de-862d-788d431fddf4 with status ACTIVE [ 691.712182] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.712182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.713289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.713289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.713289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.713289] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.713289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.713289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.713754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.713754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.715030] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.718129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.718129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.718129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.718129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.718129] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8c2e531-66aa-47de-862d-788d431fddf4 is going to be updated. [ 691.745464] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.745464] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.745464] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.745709] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.745747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.745912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8c2e531-66aa-47de-862d-788d431fddf4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.767091] env[66519]: INFO networking_nsxv3.common.synchronization [req-55a01717-0475-4dc3-b6e7-2a6a659d586d req-411fc326-66d8-4cbc-b555-97df5dbd75fa tempest-ServersTestMultiNic-666815749 tempest-ServersTestMultiNic-666815749-project-member] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 691.767091] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 691.767403] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.767596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.794036] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.794036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.794036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.795240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.795240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.795240] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.795240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.795240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.795240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.795240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.795240] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac is going to be updated. [ 691.837679] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f825e83f-7046-4bbd-969b-a037ace80c92: rpc.has_security_group_logging(os_id): False [ 691.869076] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.869076] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.869076] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.869076] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.869076] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.871726] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.871919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.872019] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.872237] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.872409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.872581] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.872709] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.873774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.873774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.873774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.873774] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.873774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.873774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.874087] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.874087] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.874212] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.874630] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.874630] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.874698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.874745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.874843] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f825e83f-7046-4bbd-969b-a037ace80c92 is going to be created. [ 691.905159] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: IN_PROGRESS for 2s [ 692.063192] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.063817] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.064013] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.065874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.065874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.088986] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: IN_PROGRESS for 2s [ 692.220090] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94ea0731-22a6-40ee-a699-ef5f6ebe0f3a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.247997] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.247997] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-578" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.248237] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-578" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.248495] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-578" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.248788] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.248958] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.249107] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.249342] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.249499] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.249711] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.249834] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.249937] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.250051] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.250157] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.250595] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.250595] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 692.281651] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.281833] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 692.282048] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.282251] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-578" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.282647] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-7ed4be88-0092-49b3-82bd-f139e5f12f47 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.282837] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-7ed4be88-0092-49b3-82bd-f139e5f12f47" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.282951] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-7ed4be88-0092-49b3-82bd-f139e5f12f47" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.283334] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-7ed4be88-0092-49b3-82bd-f139e5f12f47" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.283471] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ed4be88-0092-49b3-82bd-f139e5f12f47',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.724634] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.724634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.724634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.724634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.724634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.724634] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a is going to be created. [ 692.759292] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.759489] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.759582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.759877] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.760107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.775533] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a in Status: UNINITIALIZED for 2s [ 692.787408] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.787576] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.788114] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.788480] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.788647] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.788831] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 7ed4be88-0092-49b3-82bd-f139e5f12f47 not found, creating... [ 692.789160] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.789330] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.789442] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.789685] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.789824] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.790158] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.790397] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.790511] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.790732] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.790884] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.791033] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 7ed4be88-0092-49b3-82bd-f139e5f12f47 is going to be created. [ 692.825654] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.825945] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.826490] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.826563] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.826857] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.827227] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-7ed4be88-0092-49b3-82bd-f139e5f12f47" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.599023] env[66519]: INFO networking_nsxv3.common.synchronization [req-55a01717-0475-4dc3-b6e7-2a6a659d586d req-a1269db8-62bd-458d-8785-7a3bde932c79 service nova] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_rules [ 693.599023] env[66519]: INFO networking_nsxv3.common.synchronization [req-55a01717-0475-4dc3-b6e7-2a6a659d586d req-a1269db8-62bd-458d-8785-7a3bde932c79 service nova] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 693.599023] env[66519]: INFO networking_nsxv3.common.synchronization [req-55a01717-0475-4dc3-b6e7-2a6a659d586d req-a1269db8-62bd-458d-8785-7a3bde932c79 service nova] Enqueued Resource ID: 7ed4be88-0092-49b3-82bd-f139e5f12f47 with Priority: HIGHEST for action port [ 693.599023] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_rules [ 693.599023] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 693.599023] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ed4be88-0092-49b3-82bd-f139e5f12f47 with Priority: HIGHEST for action port [ 693.599023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.599023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.599023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.599774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.599774] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.601691] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.601885] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.602082] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ed4be88-0092-49b3-82bd-f139e5f12f47 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.602674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ed4be88-0092-49b3-82bd-f139e5f12f47" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.602674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ed4be88-0092-49b3-82bd-f139e5f12f47" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.602674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ed4be88-0092-49b3-82bd-f139e5f12f47" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.602674] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ed4be88-0092-49b3-82bd-f139e5f12f47',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.922122] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: SUCCESS [ 693.922508] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac deletion is rescheduled due to dependency. [ 693.922508] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.922654] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.922910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.923141] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.923347] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.923416] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.923600] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.923815] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.923815] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.102695] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.102852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.108354] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ed4be88-0092-49b3-82bd-f139e5f12f47 with status ACTIVE [ 694.108620] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.108774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.108845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.109115] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.109214] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.109468] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.109658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.109791] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.110020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.110153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.110439] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.110573] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.110674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.110870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.110980] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.111119] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ed4be88-0092-49b3-82bd-f139e5f12f47 is going to be updated. [ 694.113441] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: SUCCESS [ 694.113656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.144032] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.144189] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.144430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.144685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.144845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.144947] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ed4be88-0092-49b3-82bd-f139e5f12f47" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.427025] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.480810] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-854 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.481089] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-854" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.481278] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-854" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.481703] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-854" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.482082] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.482328] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.483056] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.483056] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.483056] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.483292] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 694.483468] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 694.483658] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 694.483856] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 694.483971] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 694.484105] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 694.484237] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.508273] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.508379] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 694.508553] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.508762] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-854" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.509272] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-fedffdb4-66be-4d73-88ce-71309f14a05a taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.509556] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-fedffdb4-66be-4d73-88ce-71309f14a05a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.509867] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-fedffdb4-66be-4d73-88ce-71309f14a05a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.510179] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-fedffdb4-66be-4d73-88ce-71309f14a05a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.510409] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fedffdb4-66be-4d73-88ce-71309f14a05a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.791714] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a in Status: SUCCESS [ 694.792097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.792329] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.792676] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.793012] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.793196] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.793244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.793496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.793646] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.793828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.793994] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94ea0731-22a6-40ee-a699-ef5f6ebe0f3a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.930088] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.013120] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.013352] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.013419] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.013771] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.013922] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.014094] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port fedffdb4-66be-4d73-88ce-71309f14a05a not found, creating... [ 695.014419] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.014540] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.014650] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.014882] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.015029] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.015368] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.015551] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.015676] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.016042] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.016252] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.016483] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: fedffdb4-66be-4d73-88ce-71309f14a05a is going to be created. [ 695.043730] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.043945] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.044093] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.044404] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.044685] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.044933] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-fedffdb4-66be-4d73-88ce-71309f14a05a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.298443] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94ea0731-22a6-40ee-a699-ef5f6ebe0f3a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.432961] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.433253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.433253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.433539] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.433654] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.433775] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac is going to be updated. [ 695.489989] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.489989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.489989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.490250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.490500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.513456] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: IN_PROGRESS for 2s [ 695.805040] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a: rpc.has_security_group_logging(os_id): False [ 695.836657] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.836836] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.836896] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.837115] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.837211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.837585] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.837695] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.837853] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.838456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.838456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.838456] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a is going to be created. [ 695.892521] env[66519]: INFO networking_nsxv3.common.synchronization [req-55a01717-0475-4dc3-b6e7-2a6a659d586d req-cb4f8e3d-cca6-4e7d-9167-045db2db9893 service nova] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_rules [ 695.892722] env[66519]: INFO networking_nsxv3.common.synchronization [req-55a01717-0475-4dc3-b6e7-2a6a659d586d req-cb4f8e3d-cca6-4e7d-9167-045db2db9893 service nova] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 695.892830] env[66519]: INFO networking_nsxv3.common.synchronization [req-55a01717-0475-4dc3-b6e7-2a6a659d586d req-cb4f8e3d-cca6-4e7d-9167-045db2db9893 service nova] Enqueued Resource ID: fedffdb4-66be-4d73-88ce-71309f14a05a with Priority: HIGHEST for action port [ 695.893522] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_rules [ 695.893657] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 695.893776] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fedffdb4-66be-4d73-88ce-71309f14a05a with Priority: HIGHEST for action port [ 695.894096] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.894148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.894435] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.894531] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.894709] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-fedffdb4-66be-4d73-88ce-71309f14a05a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.894816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fedffdb4-66be-4d73-88ce-71309f14a05a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.895030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fedffdb4-66be-4d73-88ce-71309f14a05a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.895163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fedffdb4-66be-4d73-88ce-71309f14a05a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.895163] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fedffdb4-66be-4d73-88ce-71309f14a05a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.923572] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.924079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.924163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.924397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.924661] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.959425] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a in Status: IN_PROGRESS for 2s [ 696.338401] env[66519]: INFO networking_nsxv3.common.synchronization [req-943e41d1-8cef-4811-b5ea-0a1007893ab9 req-b6235edf-b21c-41f8-b5b6-dd425a43a400 tempest-MultipleCreateTestJSON-1661318798 tempest-MultipleCreateTestJSON-1661318798-project-member] Enqueued Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 696.339177] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 696.339984] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.339984] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.339984] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.340259] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.340311] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.340469] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.340599] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.341355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.341355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.341355] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.400378] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fedffdb4-66be-4d73-88ce-71309f14a05a with status ACTIVE [ 696.400711] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.400935] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.401037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.402046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.402046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.402046] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.402046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.402046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.402046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.402671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.402671] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.402671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.402671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.403656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.403656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.403656] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fedffdb4-66be-4d73-88ce-71309f14a05a is going to be updated. [ 696.434521] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.434766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.434982] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.435373] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.435615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.435840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fedffdb4-66be-4d73-88ce-71309f14a05a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.831386] env[66519]: INFO networking_nsxv3.common.synchronization [req-31824b05-98fd-4df2-a281-4e29997bed80 req-199e4379-8f37-429a-9e38-2d9d9d5e9400 tempest-ListServersNegativeTestJSON-1730331396 tempest-ListServersNegativeTestJSON-1730331396-project-member] Enqueued Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_members [ 696.832268] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_members [ 696.832668] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.832811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.832881] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.833370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.833766] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.833766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.833766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.834672] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.834672] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.834672] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.844623] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.151019] env[66519]: INFO networking_nsxv3.common.synchronization [req-03c2ccd7-0d23-4a11-ac2b-d2709d87264a req-c9a081ba-9cef-4eec-b067-b2eb8146c841 tempest-VolumesAssistedSnapshotsTest-1753704316 tempest-VolumesAssistedSnapshotsTest-1753704316-project-member] Enqueued Resource ID: facac47b-64fc-4659-9f54-1cb6066b4b88 with Priority: HIGHEST for action security_group_members [ 697.152357] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: facac47b-64fc-4659-9f54-1cb6066b4b88 with Priority: HIGHEST for action security_group_members [ 697.152357] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-facac47b-64fc-4659-9f54-1cb6066b4b88 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.152512] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.152731] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.153149] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.153626] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.153956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.154116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.154746] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.154746] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.154746] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('facac47b-64fc-4659-9f54-1cb6066b4b88',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.336615] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.348125] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.531027] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: SUCCESS [ 697.531027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.531027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.531027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.531027] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.531027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.531027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.531027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.531027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.531027] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.658117] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.658117] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.658117] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.658117] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.658336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.658470] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.658600] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.659797] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.659797] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.659905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.660062] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: facac47b-64fc-4659-9f54-1cb6066b4b88 is going to be updated. [ 697.733660] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.733908] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.734448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.734448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.734684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.751393] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: facac47b-64fc-4659-9f54-1cb6066b4b88 in Status: IN_PROGRESS for 2s [ 697.838986] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.850331] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.850569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.850569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.850842] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.851040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.851485] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db is going to be updated. [ 697.891287] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.891287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.891287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.891287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.891287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.905624] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: IN_PROGRESS for 2s [ 697.973713] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a in Status: SUCCESS [ 697.974456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.035726] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.341915] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.342184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.342292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.342655] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.342832] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.342997] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5530bb2-b2db-4078-af78-1410edb05dd7 is going to be updated. [ 698.381380] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.381514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.381581] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.381821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.381966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.394376] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: IN_PROGRESS for 2s [ 698.539987] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.052780] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.052780] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.052780] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.052780] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.052780] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.052780] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac is going to be updated. [ 699.101102] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.101102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.101102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.101102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.101102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.106339] env[66519]: INFO networking_nsxv3.common.synchronization [req-19b71e63-7762-42f4-9386-72c40fcfb041 req-920b54fb-cab8-42c0-ab90-f13858df6eb6 tempest-MultipleCreateTestJSON-1661318798 tempest-MultipleCreateTestJSON-1661318798-project-member] Enqueued Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 699.107289] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 699.107894] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.108399] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.112550] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: IN_PROGRESS for 2s [ 699.153315] env[66519]: INFO networking_nsxv3.common.synchronization [req-c0d837c4-bf04-4f22-8e35-4938a7ce70b8 req-6fa10da6-ccbc-4d6f-a218-7f53800b8a40 tempest-ListServersNegativeTestJSON-1730331396 tempest-ListServersNegativeTestJSON-1730331396-project-member] Enqueued Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_members [ 699.153737] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGHEST for action security_group_members [ 699.154347] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.154491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.564163] env[66519]: INFO networking_nsxv3.common.synchronization [req-19e26fa5-8b87-48df-8dbd-73dcee873b9a req-aaab6754-c486-4aad-886a-da5f52edcb14 tempest-VolumesAdminNegativeTest-422292084 tempest-VolumesAdminNegativeTest-422292084-project-member] Enqueued Resource ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c with Priority: HIGHEST for action security_group_members [ 699.564163] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c with Priority: HIGHEST for action security_group_members [ 699.564163] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.564163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.566898] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.567258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.567634] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.567960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.568179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.568670] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.570132] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.570132] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc90b596-5915-4a67-a6d8-a20bd8cf9e3c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.734218] env[66519]: INFO networking_nsxv3.common.synchronization [req-f8863beb-7f52-4562-a196-c34281a57b34 req-6c519a08-4750-4dca-9c0f-2ae7592a14c7 tempest-ImagesNegativeTestJSON-1130211233 tempest-ImagesNegativeTestJSON-1130211233-project-member] Enqueued Resource ID: e0272502-d55a-4dab-9801-a7c27a17a4ef with Priority: HIGHEST for action security_group_members [ 699.736259] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0272502-d55a-4dab-9801-a7c27a17a4ef with Priority: HIGHEST for action security_group_members [ 699.736259] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0272502-d55a-4dab-9801-a7c27a17a4ef taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.736444] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.736616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.737257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.737257] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.737257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.737257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.737550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.737550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.738036] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0272502-d55a-4dab-9801-a7c27a17a4ef',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.763752] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: facac47b-64fc-4659-9f54-1cb6066b4b88 in Status: SUCCESS [ 699.763941] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: facac47b-64fc-4659-9f54-1cb6066b4b88 deletion is rescheduled due to dependency. [ 699.764066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-facac47b-64fc-4659-9f54-1cb6066b4b88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.921316] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: SUCCESS [ 699.921316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.921316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.921316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.921316] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.921316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.921316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.921926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.921926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.922115] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.072350] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.073364] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.073364] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.073597] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.073720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.074301] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.074301] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.074301] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.074875] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.074875] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.074875] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c is going to be updated. [ 700.120649] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.120649] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.120649] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.120649] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.120932] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.146795] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c in Status: IN_PROGRESS for 2s [ 700.240261] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.240465] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.240519] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.241064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.241064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.241230] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.241230] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.241324] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.241437] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.241577] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.241634] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0272502-d55a-4dab-9801-a7c27a17a4ef already deleted. [ 700.241666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.286050] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-209 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.286393] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-209" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.286730] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-209" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.287064] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-209" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.287468] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.287689] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.287854] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.288290] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.288517] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.288778] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.288893] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.289092] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.290030] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.290030] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.290030] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.290030] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 700.328295] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 700.328472] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 700.328523] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 700.328720] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-209" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.329133] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-74357d8d-1efd-4452-abd2-54c157925d43 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.329363] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-74357d8d-1efd-4452-abd2-54c157925d43" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.329526] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-74357d8d-1efd-4452-abd2-54c157925d43" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.329959] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-74357d8d-1efd-4452-abd2-54c157925d43" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.330143] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74357d8d-1efd-4452-abd2-54c157925d43',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.406979] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: SUCCESS [ 700.407259] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.407469] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.407736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.407935] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.408072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.408138] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.408350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.408440] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.408542] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.425093] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.425381] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.425381] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.425594] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.425698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.425903] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.426016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.426077] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.426247] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.426318] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.426432] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db is going to be updated. [ 700.465390] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.465567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.465651] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.465926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.466134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.487787] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: IN_PROGRESS for 2s [ 700.833076] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.834256] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.834256] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.834256] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.834584] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.834680] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 74357d8d-1efd-4452-abd2-54c157925d43 not found, creating... [ 700.835986] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.835986] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.835986] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.835986] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.835986] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.835986] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.835986] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.836433] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.836433] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.836534] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.836809] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 74357d8d-1efd-4452-abd2-54c157925d43 is going to be created. [ 700.863252] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.863742] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.863948] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.864285] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.864580] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.865097] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-74357d8d-1efd-4452-abd2-54c157925d43" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.911601] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.912844] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.913292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.913641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.913817] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.914152] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.914360] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.914491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.914752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.914900] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.915069] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5530bb2-b2db-4078-af78-1410edb05dd7 is going to be updated. [ 700.962638] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.962916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.962916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.963177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.963298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.976259] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: IN_PROGRESS for 2s [ 701.128367] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: SUCCESS [ 701.128367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.128367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.128367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.128367] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.128367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.128367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.128367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.128367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.128367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.128367] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.129310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.129382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.129659] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.129950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.130063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.130264] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.130392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.131583] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.634528] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.634528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.634676] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.653377] env[66519]: INFO networking_nsxv3.common.synchronization [req-f8863beb-7f52-4562-a196-c34281a57b34 req-c0dbe478-acb9-413a-8526-dcddec8f1c68 service nova] Enqueued Resource ID: e0272502-d55a-4dab-9801-a7c27a17a4ef with Priority: HIGHEST for action security_group_rules [ 701.653563] env[66519]: INFO networking_nsxv3.common.synchronization [req-f8863beb-7f52-4562-a196-c34281a57b34 req-c0dbe478-acb9-413a-8526-dcddec8f1c68 service nova] Enqueued Resource ID: e0272502-d55a-4dab-9801-a7c27a17a4ef with Priority: HIGHEST for action security_group_members [ 701.653693] env[66519]: INFO networking_nsxv3.common.synchronization [req-f8863beb-7f52-4562-a196-c34281a57b34 req-c0dbe478-acb9-413a-8526-dcddec8f1c68 service nova] Enqueued Resource ID: 74357d8d-1efd-4452-abd2-54c157925d43 with Priority: HIGHEST for action port [ 701.654185] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0272502-d55a-4dab-9801-a7c27a17a4ef with Priority: HIGHEST for action security_group_rules [ 701.654325] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0272502-d55a-4dab-9801-a7c27a17a4ef with Priority: HIGHEST for action security_group_members [ 701.654424] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74357d8d-1efd-4452-abd2-54c157925d43 with Priority: HIGHEST for action port [ 701.654684] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e0272502-d55a-4dab-9801-a7c27a17a4ef taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.654823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.654895] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.655477] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.655621] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e0272502-d55a-4dab-9801-a7c27a17a4ef',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.657031] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0272502-d55a-4dab-9801-a7c27a17a4ef taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.657210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.657338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.657558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.657771] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.657949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.658044] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.658279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.658383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.658498] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0272502-d55a-4dab-9801-a7c27a17a4ef',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.660417] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-74357d8d-1efd-4452-abd2-54c157925d43 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.660486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74357d8d-1efd-4452-abd2-54c157925d43" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.660486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74357d8d-1efd-4452-abd2-54c157925d43" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.661167] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74357d8d-1efd-4452-abd2-54c157925d43" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.661167] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74357d8d-1efd-4452-abd2-54c157925d43',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.137437] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.158043] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0272502-d55a-4dab-9801-a7c27a17a4ef taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.158227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.159243] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c in Status: SUCCESS [ 702.159851] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc90b596-5915-4a67-a6d8-a20bd8cf9e3c deletion is rescheduled due to dependency. [ 702.159851] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc90b596-5915-4a67-a6d8-a20bd8cf9e3c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.161285] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e0272502-d55a-4dab-9801-a7c27a17a4ef',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.163098] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74357d8d-1efd-4452-abd2-54c157925d43 with status ACTIVE [ 702.163338] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.163466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.163533] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.163734] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.165462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.165462] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.165462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.165462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.165462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.165462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.165462] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.165462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.165462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.165462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.165462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.165462] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74357d8d-1efd-4452-abd2-54c157925d43 is going to be updated. [ 702.202378] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.202378] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.202378] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.202378] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.202378] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.202378] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74357d8d-1efd-4452-abd2-54c157925d43" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.506679] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: SUCCESS [ 702.506679] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db deletion is rescheduled due to dependency. [ 702.506679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.639854] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.640107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.640238] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.641911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.641911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.641911] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac is going to be updated. [ 702.663774] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e0272502-d55a-4dab-9801-a7c27a17a4ef',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.679804] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.679961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.680044] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.680276] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.680431] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.693667] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: IN_PROGRESS for 2s [ 702.988350] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5530bb2-b2db-4078-af78-1410edb05dd7 in Status: SUCCESS [ 702.988554] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5530bb2-b2db-4078-af78-1410edb05dd7 deletion is rescheduled due to dependency. [ 702.988734] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.168345] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.170067] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.170067] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.170249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.171318] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.171318] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0272502-d55a-4dab-9801-a7c27a17a4ef is going to be created. [ 703.198957] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.199140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.199189] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.199403] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.199571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.214655] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0272502-d55a-4dab-9801-a7c27a17a4ef in Status: UNINITIALIZED for 2s [ 704.256624] env[66519]: INFO networking_nsxv3.common.synchronization [None req-0b63accc-c315-447a-b966-ca5824aa6523 tempest-MigrationsAdminTest-1659008040 tempest-MigrationsAdminTest-1659008040-project-member] Enqueued Resource ID: aa6c7a37-492c-4b46-9b8e-7a6ce6c059ea with Priority: HIGHEST for action security_group_rules [ 704.257811] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa6c7a37-492c-4b46-9b8e-7a6ce6c059ea with Priority: HIGHEST for action security_group_rules [ 704.259496] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa6c7a37-492c-4b46-9b8e-7a6ce6c059ea taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.259496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa6c7a37-492c-4b46-9b8e-7a6ce6c059ea" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.259496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa6c7a37-492c-4b46-9b8e-7a6ce6c059ea" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.259496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa6c7a37-492c-4b46-9b8e-7a6ce6c059ea" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.259496] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa6c7a37-492c-4b46-9b8e-7a6ce6c059ea',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.398026] env[66519]: INFO networking_nsxv3.common.synchronization [None req-239a1624-61da-4763-acdf-a9ca81870926 tempest-MigrationsAdminTest-1659008040 tempest-MigrationsAdminTest-1659008040-project-member] Enqueued Resource ID: aa6c7a37-492c-4b46-9b8e-7a6ce6c059ea with Priority: HIGHEST for action security_group_rules [ 704.398749] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa6c7a37-492c-4b46-9b8e-7a6ce6c059ea with Priority: HIGHEST for action security_group_rules [ 704.399104] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa6c7a37-492c-4b46-9b8e-7a6ce6c059ea taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.399520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa6c7a37-492c-4b46-9b8e-7a6ce6c059ea" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.708911] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: SUCCESS [ 704.708911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.709158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.709914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.710156] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.710301] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.711466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.711466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.711466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.711466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.711466] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.711466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.711466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.711466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.711934] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.711934] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.711934] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.712098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.712279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.712453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.712590] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.785037] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.785197] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.785272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.785528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.785606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.785704] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa6c7a37-492c-4b46-9b8e-7a6ce6c059ea already deleted. [ 704.785789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa6c7a37-492c-4b46-9b8e-7a6ce6c059ea" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.785961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa6c7a37-492c-4b46-9b8e-7a6ce6c059ea" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.786156] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa6c7a37-492c-4b46-9b8e-7a6ce6c059ea" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.786240] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa6c7a37-492c-4b46-9b8e-7a6ce6c059ea',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.215408] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 376a7ea3-3e4d-4872-be2f-8bc029c25fac: rpc.has_security_group_logging(os_id): False [ 705.229028] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0272502-d55a-4dab-9801-a7c27a17a4ef in Status: SUCCESS [ 705.229428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.229736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.229892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.230891] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.231338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.231338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.231501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.231535] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.233625] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.233625] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e0272502-d55a-4dab-9801-a7c27a17a4ef',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.239350] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.239556] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.239556] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.239743] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.239799] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.240051] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.240181] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.240218] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.240414] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.240523] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.240681] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.240777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.240895] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.240998] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.241109] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.241333] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.241423] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.241462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.242055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.242055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.242055] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac is going to be updated. [ 705.330576] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.330576] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.330576] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.330576] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.330576] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.330576] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa6c7a37-492c-4b46-9b8e-7a6ce6c059ea already deleted. [ 705.330576] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa6c7a37-492c-4b46-9b8e-7a6ce6c059ea" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.345756] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.346375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.346620] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.346963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.347219] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.363187] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: IN_PROGRESS for 2s [ 705.735354] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0272502-d55a-4dab-9801-a7c27a17a4ef taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.737711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.737711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.737711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.737711] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.737711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.737711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.737711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.738026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.738026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.738087] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0272502-d55a-4dab-9801-a7c27a17a4ef taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.738265] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.738265] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.738393] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.739298] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.739298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.739298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.739298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.739298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.739298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.739673] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e0272502-d55a-4dab-9801-a7c27a17a4ef',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.869920] env[66519]: INFO networking_nsxv3.common.synchronization [None req-5cc67a99-4562-4613-8c9c-15c015cfe437 None None] Enqueued Resource ID: 29e52a0d-3de8-42a3-b544-fcaf259f8632 with Priority: HIGHEST for action port [ 705.870584] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29e52a0d-3de8-42a3-b544-fcaf259f8632 with Priority: HIGHEST for action port [ 705.871052] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-29e52a0d-3de8-42a3-b544-fcaf259f8632 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.871204] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29e52a0d-3de8-42a3-b544-fcaf259f8632" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.871486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29e52a0d-3de8-42a3-b544-fcaf259f8632" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.871551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29e52a0d-3de8-42a3-b544-fcaf259f8632" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.871657] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29e52a0d-3de8-42a3-b544-fcaf259f8632',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.243080] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e0272502-d55a-4dab-9801-a7c27a17a4ef: rpc.has_security_group_logging(os_id): False [ 706.266212] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.266212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.266212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.266212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.266212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.266212] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.266212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.266212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.266212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.266212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.266212] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.266715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.266715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.266715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.266715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.266994] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.266994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.266994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.268718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.268718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.268718] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e0272502-d55a-4dab-9801-a7c27a17a4ef is going to be created. [ 706.357242] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.357242] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.357242] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.357242] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.357242] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.375186] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29e52a0d-3de8-42a3-b544-fcaf259f8632 [ 706.375186] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.375186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.375186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.375463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.375627] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.375702] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29e52a0d-3de8-42a3-b544-fcaf259f8632 already deleted. [ 706.375759] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29e52a0d-3de8-42a3-b544-fcaf259f8632" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.378457] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0272502-d55a-4dab-9801-a7c27a17a4ef in Status: IN_PROGRESS for 2s [ 706.433368] env[66519]: INFO networking_nsxv3.common.synchronization [req-23276ed0-3928-4291-8600-a3739177973a req-2c93610e-66e9-4e22-afe1-2e6fbead2cbd tempest-AttachVolumeShelveTestJSON-264753527 tempest-AttachVolumeShelveTestJSON-264753527-project-member] Enqueued Resource ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 with Priority: HIGHEST for action security_group_members [ 706.434079] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 with Priority: HIGHEST for action security_group_members [ 706.434447] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.434575] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.434635] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.434947] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.439304] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.439516] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.439653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.439758] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.439854] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.439949] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb3bbf89-6cbf-4b9e-b793-607035a2d9c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.942916] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.943136] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.943136] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.943326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.943390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.943617] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.943732] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.943796] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.944023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.944111] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.944199] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 already deleted. [ 706.944278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.041287] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-947 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.041484] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-947" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.041600] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-947" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.041924] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-947" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.042226] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.042467] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.042585] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.042714] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.042860] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.045104] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.045458] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.045596] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.045707] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.045844] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.046121] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.046322] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.078133] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.078133] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 707.078133] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.078345] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-947" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.078766] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.078966] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.079099] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.079521] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.079673] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e0d6cd2-3221-4000-9d6c-112b9e9ede4a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.380987] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: SUCCESS [ 707.380987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.380987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.381333] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.381333] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.583474] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.587020] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.587020] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.587020] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.587020] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.587020] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 5e0d6cd2-3221-4000-9d6c-112b9e9ede4a not found, creating... [ 707.587020] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.587020] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.587020] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.587020] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.587020] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.587417] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.587417] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.587417] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.587417] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.587417] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.587417] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 5e0d6cd2-3221-4000-9d6c-112b9e9ede4a is going to be created. [ 707.611166] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.611419] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.611580] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.613057] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.613057] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.613057] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.775549] env[66519]: INFO networking_nsxv3.common.synchronization [None req-cf8a4046-3ec7-4541-ad7c-5f1ffdb439d0 None None] Enqueued Resource ID: cd0125bd-22ff-43ee-bcec-97077744e5cf with Priority: HIGHEST for action port [ 707.776145] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd0125bd-22ff-43ee-bcec-97077744e5cf with Priority: HIGHEST for action port [ 707.776552] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd0125bd-22ff-43ee-bcec-97077744e5cf taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.776703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd0125bd-22ff-43ee-bcec-97077744e5cf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.776764] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd0125bd-22ff-43ee-bcec-97077744e5cf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.777079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd0125bd-22ff-43ee-bcec-97077744e5cf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.777251] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd0125bd-22ff-43ee-bcec-97077744e5cf',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.883338] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.883524] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.883628] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.883865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.884054] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.884174] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.884274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.884490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.884577] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.884666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.884755] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.896262] env[66519]: INFO networking_nsxv3.common.synchronization [None req-9cfcd25f-26e0-4c4a-bbda-d8fd5d41f64b None None] Enqueued Resource ID: 04e0428e-6e9d-4561-86f3-5dd5e6371314 with Priority: HIGHEST for action port [ 707.896511] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04e0428e-6e9d-4561-86f3-5dd5e6371314 with Priority: HIGHEST for action port [ 707.897076] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-04e0428e-6e9d-4561-86f3-5dd5e6371314 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.897203] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04e0428e-6e9d-4561-86f3-5dd5e6371314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.897260] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04e0428e-6e9d-4561-86f3-5dd5e6371314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.897693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04e0428e-6e9d-4561-86f3-5dd5e6371314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.897693] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04e0428e-6e9d-4561-86f3-5dd5e6371314',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.279410] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd0125bd-22ff-43ee-bcec-97077744e5cf [ 708.279648] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.279778] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.279849] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.280157] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.280902] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.280902] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd0125bd-22ff-43ee-bcec-97077744e5cf already deleted. [ 708.280902] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd0125bd-22ff-43ee-bcec-97077744e5cf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.346528] env[66519]: INFO networking_nsxv3.common.synchronization [req-23276ed0-3928-4291-8600-a3739177973a req-84ed675d-d042-4cf7-bb47-2460a522be27 service nova] Enqueued Resource ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 with Priority: HIGHEST for action security_group_rules [ 708.346689] env[66519]: INFO networking_nsxv3.common.synchronization [req-23276ed0-3928-4291-8600-a3739177973a req-84ed675d-d042-4cf7-bb47-2460a522be27 service nova] Enqueued Resource ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 with Priority: HIGHEST for action security_group_members [ 708.349740] env[66519]: INFO networking_nsxv3.common.synchronization [req-23276ed0-3928-4291-8600-a3739177973a req-84ed675d-d042-4cf7-bb47-2460a522be27 service nova] Enqueued Resource ID: 5e0d6cd2-3221-4000-9d6c-112b9e9ede4a with Priority: HIGHEST for action port [ 708.349740] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 with Priority: HIGHEST for action security_group_rules [ 708.349740] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 with Priority: HIGHEST for action security_group_members [ 708.349740] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e0d6cd2-3221-4000-9d6c-112b9e9ede4a with Priority: HIGHEST for action port [ 708.349740] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.349740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.349740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.349740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.349740] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb3bbf89-6cbf-4b9e-b793-607035a2d9c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.350856] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.350976] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.351149] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.351244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.351401] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.351496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.351554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.351693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.351772] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.351890] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb3bbf89-6cbf-4b9e-b793-607035a2d9c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.352847] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.352947] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.353280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.355240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.355904] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e0d6cd2-3221-4000-9d6c-112b9e9ede4a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.388445] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.388735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.388735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.389001] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.389068] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.390171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.390171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.390171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.390171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.391480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.391480] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.391480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.391480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.391480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.391974] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.391974] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.391974] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.392192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.392256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.392363] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.392424] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.395498] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e0272502-d55a-4dab-9801-a7c27a17a4ef in Status: SUCCESS [ 708.396035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.402346] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04e0428e-6e9d-4561-86f3-5dd5e6371314 [ 708.402346] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.402476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.402476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.402793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.402793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.402891] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04e0428e-6e9d-4561-86f3-5dd5e6371314 already deleted. [ 708.402891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04e0428e-6e9d-4561-86f3-5dd5e6371314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.858887] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb3bbf89-6cbf-4b9e-b793-607035a2d9c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.860459] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.864022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.864022] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e0d6cd2-3221-4000-9d6c-112b9e9ede4a with status ACTIVE [ 708.864022] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.864022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.864022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.865221] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.865448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.865751] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.865926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.866028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.870250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.870250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.870250] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.870250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.870250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.870250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.870250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.870250] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e0d6cd2-3221-4000-9d6c-112b9e9ede4a is going to be updated. [ 708.891717] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.891949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.891949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.892591] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.892591] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.892591] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.895375] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 376a7ea3-3e4d-4872-be2f-8bc029c25fac: rpc.has_security_group_logging(os_id): False [ 708.915374] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.915374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.915374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.915374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.915634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.915634] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.915708] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.915763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.915917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.915991] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.918016] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.918016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.918016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.918016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.918016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.918016] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.918016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.918016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.918016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.918016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.918016] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac is going to be updated. [ 708.935999] env[66519]: INFO networking_nsxv3.common.synchronization [req-c1697a14-c416-406f-9c08-cf1c18c99806 req-54a6310f-90d2-40ad-b5a7-4f0f3882b99a tempest-InstanceActionsV221TestJSON-1179840958 tempest-InstanceActionsV221TestJSON-1179840958-project-member] Enqueued Resource ID: a769e09f-7583-4789-b39d-5853c1dfcd1c with Priority: HIGHEST for action security_group_members [ 708.936749] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a769e09f-7583-4789-b39d-5853c1dfcd1c with Priority: HIGHEST for action security_group_members [ 708.937130] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a769e09f-7583-4789-b39d-5853c1dfcd1c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.938078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.938078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.938078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.938078] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.938078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.938078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.938078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.938341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.938341] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a769e09f-7583-4789-b39d-5853c1dfcd1c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.019293] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.019466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.019501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.019711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.019864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.035860] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: IN_PROGRESS for 2s [ 709.318690] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-417 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.318690] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-417" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.318690] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-417" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.318690] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-417" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.319374] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.319835] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.320073] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.320384] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.320616] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.322024] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.322024] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.322024] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.322024] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.322024] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.322024] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.322024] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.353615] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.353769] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 709.353904] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.354092] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-417" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.354464] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-021e1b66-4db2-4715-965f-bed2df6b7cf5 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.354612] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-021e1b66-4db2-4715-965f-bed2df6b7cf5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.354732] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-021e1b66-4db2-4715-965f-bed2df6b7cf5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.355054] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-021e1b66-4db2-4715-965f-bed2df6b7cf5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.355190] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('021e1b66-4db2-4715-965f-bed2df6b7cf5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.362414] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb3bbf89-6cbf-4b9e-b793-607035a2d9c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.442952] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.442952] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.442952] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.442952] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.442952] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.442952] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.442952] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.442952] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.442952] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.442952] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.442952] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a769e09f-7583-4789-b39d-5853c1dfcd1c already deleted. [ 709.442952] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.858596] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.858730] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.858806] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.859082] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.859228] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.859376] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 021e1b66-4db2-4715-965f-bed2df6b7cf5 not found, creating... [ 709.859948] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.859948] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.859948] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.860281] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.860281] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.860474] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.860614] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.861259] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.861259] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.862498] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.862498] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 021e1b66-4db2-4715-965f-bed2df6b7cf5 is going to be created. [ 709.869977] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.869977] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.869977] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.869977] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.869977] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.870279] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 is going to be created. [ 709.886517] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.886798] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.886859] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.887330] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.887454] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.887792] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-021e1b66-4db2-4715-965f-bed2df6b7cf5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.896446] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.896446] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.896446] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.896789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.896789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.910369] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 in Status: UNINITIALIZED for 2s [ 710.437326] env[66519]: INFO networking_nsxv3.common.synchronization [None req-791e268c-c546-40c1-b2f1-311aa08c3f63 None None] Enqueued Resource ID: 29630ab8-cd75-4d60-84c6-374d667fdeb7 with Priority: HIGHEST for action port [ 710.438199] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29630ab8-cd75-4d60-84c6-374d667fdeb7 with Priority: HIGHEST for action port [ 710.438395] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-29630ab8-cd75-4d60-84c6-374d667fdeb7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.438480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29630ab8-cd75-4d60-84c6-374d667fdeb7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.438520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29630ab8-cd75-4d60-84c6-374d667fdeb7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.438970] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29630ab8-cd75-4d60-84c6-374d667fdeb7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.438970] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29630ab8-cd75-4d60-84c6-374d667fdeb7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.681214] env[66519]: INFO networking_nsxv3.common.synchronization [req-c1697a14-c416-406f-9c08-cf1c18c99806 req-9e5da7eb-5cda-435a-bf09-927f79b7774e service nova] Enqueued Resource ID: a769e09f-7583-4789-b39d-5853c1dfcd1c with Priority: HIGHEST for action security_group_rules [ 710.681491] env[66519]: INFO networking_nsxv3.common.synchronization [req-c1697a14-c416-406f-9c08-cf1c18c99806 req-9e5da7eb-5cda-435a-bf09-927f79b7774e service nova] Enqueued Resource ID: a769e09f-7583-4789-b39d-5853c1dfcd1c with Priority: HIGHEST for action security_group_members [ 710.681537] env[66519]: INFO networking_nsxv3.common.synchronization [req-c1697a14-c416-406f-9c08-cf1c18c99806 req-9e5da7eb-5cda-435a-bf09-927f79b7774e service nova] Enqueued Resource ID: 021e1b66-4db2-4715-965f-bed2df6b7cf5 with Priority: HIGHEST for action port [ 710.682055] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a769e09f-7583-4789-b39d-5853c1dfcd1c with Priority: HIGHEST for action security_group_rules [ 710.682203] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a769e09f-7583-4789-b39d-5853c1dfcd1c with Priority: HIGHEST for action security_group_members [ 710.682346] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 021e1b66-4db2-4715-965f-bed2df6b7cf5 with Priority: HIGHEST for action port [ 710.682592] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a769e09f-7583-4789-b39d-5853c1dfcd1c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.682717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.682774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.683774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.683867] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a769e09f-7583-4789-b39d-5853c1dfcd1c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.685099] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a769e09f-7583-4789-b39d-5853c1dfcd1c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.685228] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.685298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.692038] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.692038] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.692038] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.692038] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.692038] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.692038] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.692038] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a769e09f-7583-4789-b39d-5853c1dfcd1c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.692038] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-021e1b66-4db2-4715-965f-bed2df6b7cf5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.692038] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-021e1b66-4db2-4715-965f-bed2df6b7cf5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.692038] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-021e1b66-4db2-4715-965f-bed2df6b7cf5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.692038] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-021e1b66-4db2-4715-965f-bed2df6b7cf5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.692038] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('021e1b66-4db2-4715-965f-bed2df6b7cf5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.775050] env[66519]: INFO networking_nsxv3.common.synchronization [None req-8d83a86e-adaf-46ec-9347-56f9a2d3dff7 tempest-AttachInterfacesUnderV243Test-1907112666 tempest-AttachInterfacesUnderV243Test-1907112666-project-member] Enqueued Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_rules [ 710.775939] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_rules [ 710.776291] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.776418] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.776744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.776822] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.776921] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.943453] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29630ab8-cd75-4d60-84c6-374d667fdeb7 [ 710.943801] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.943918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.943918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.944807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.944949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.945150] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29630ab8-cd75-4d60-84c6-374d667fdeb7 already deleted. [ 710.945225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29630ab8-cd75-4d60-84c6-374d667fdeb7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.974862] env[66519]: INFO networking_nsxv3.common.synchronization [None req-bc6f7dfe-531e-419a-b1d2-c4561a3eda58 tempest-AttachInterfacesUnderV243Test-1907112666 tempest-AttachInterfacesUnderV243Test-1907112666-project-member] Enqueued Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_rules [ 710.974862] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_rules [ 710.974862] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.974862] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.077085] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: SUCCESS [ 711.077234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.195063] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a769e09f-7583-4789-b39d-5853c1dfcd1c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.195205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.195524] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a769e09f-7583-4789-b39d-5853c1dfcd1c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.196357] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 021e1b66-4db2-4715-965f-bed2df6b7cf5 with status ACTIVE [ 711.196573] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.196681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.196733] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.196934] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.197029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.197222] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.197303] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.197387] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.197515] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.197596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.197864] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.198362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.198362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.198362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.198362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.198362] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 021e1b66-4db2-4715-965f-bed2df6b7cf5 is going to be updated. [ 711.218096] env[66519]: INFO networking_nsxv3.common.synchronization [req-ed5bf5d3-25a3-4398-b74a-6a9fb2589ae2 req-756409b4-02c8-437d-85e9-f7317b6c95ce tempest-ServersTestBootFromVolume-1611733282 tempest-ServersTestBootFromVolume-1611733282-project-member] Enqueued Resource ID: 245777f4-8235-4258-8d94-22f44ade6a9c with Priority: HIGHEST for action security_group_members [ 711.218794] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 245777f4-8235-4258-8d94-22f44ade6a9c with Priority: HIGHEST for action security_group_members [ 711.219107] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-245777f4-8235-4258-8d94-22f44ade6a9c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.219226] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.219287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.219660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.220129] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.220129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.220129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.220129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.220129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.220400] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('245777f4-8235-4258-8d94-22f44ade6a9c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.222014] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.222138] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.222190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.222329] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.222454] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.222600] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-021e1b66-4db2-4715-965f-bed2df6b7cf5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.304074] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.304295] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.304478] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.304840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.304980] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.305167] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 already deleted. [ 711.305305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.305625] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.305865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.306026] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.701099] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a769e09f-7583-4789-b39d-5853c1dfcd1c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.724524] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.724668] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.724781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.724946] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.725041] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.725234] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.725374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.725480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.725633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.725707] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.725795] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 245777f4-8235-4258-8d94-22f44ade6a9c already deleted. [ 711.725887] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.835548] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.835937] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.835937] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.836552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.836552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.836889] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 already deleted. [ 711.836889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.921891] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 in Status: SUCCESS [ 711.924414] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.924414] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.924414] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.924414] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.924414] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.924414] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.925094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.925188] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.925289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.925477] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb3bbf89-6cbf-4b9e-b793-607035a2d9c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.161244] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-288 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.161450] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-288" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.161575] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-288" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.161911] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-288" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.163232] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.163232] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.163232] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.165888] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.166048] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.166260] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 712.166378] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 712.166505] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 712.166646] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 712.166769] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 712.166868] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 712.166998] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 712.187485] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 712.187485] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 712.187728] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 712.187820] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-288" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.188271] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-fcdcfbea-2009-4f70-996f-1c62b49f2bb0 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.188467] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-fcdcfbea-2009-4f70-996f-1c62b49f2bb0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.188572] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-fcdcfbea-2009-4f70-996f-1c62b49f2bb0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.188885] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-fcdcfbea-2009-4f70-996f-1c62b49f2bb0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.189031] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcdcfbea-2009-4f70-996f-1c62b49f2bb0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.204929] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.205157] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.205157] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.205451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.205538] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.205639] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a769e09f-7583-4789-b39d-5853c1dfcd1c is going to be created. [ 712.242318] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.242499] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.242585] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.242803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.243086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.259699] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a769e09f-7583-4789-b39d-5853c1dfcd1c in Status: UNINITIALIZED for 2s [ 712.428646] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb3bbf89-6cbf-4b9e-b793-607035a2d9c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.435282] env[66519]: INFO networking_nsxv3.common.synchronization [None req-178213bd-bfed-4f4c-a6b0-61be3aafbe9c None None] Enqueued Resource ID: d1c1d211-a748-4105-a901-9961a86eef45 with Priority: HIGHEST for action port [ 712.438220] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1c1d211-a748-4105-a901-9961a86eef45 with Priority: HIGHEST for action port [ 712.438220] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1c1d211-a748-4105-a901-9961a86eef45 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.438220] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1c1d211-a748-4105-a901-9961a86eef45" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.438220] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1c1d211-a748-4105-a901-9961a86eef45" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.438731] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1c1d211-a748-4105-a901-9961a86eef45" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.438731] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1c1d211-a748-4105-a901-9961a86eef45',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.692700] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.692983] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.693158] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.693428] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.693607] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.693766] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port fcdcfbea-2009-4f70-996f-1c62b49f2bb0 not found, creating... [ 712.694077] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.694290] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.694476] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.694684] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.694830] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.695194] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.695377] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.695571] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.695760] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.695877] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.696050] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: fcdcfbea-2009-4f70-996f-1c62b49f2bb0 is going to be created. [ 712.723260] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.723260] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.723260] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.723861] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.724912] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.724912] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-fcdcfbea-2009-4f70-996f-1c62b49f2bb0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.932419] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb3bbf89-6cbf-4b9e-b793-607035a2d9c3: rpc.has_security_group_logging(os_id): False [ 712.942788] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1c1d211-a748-4105-a901-9961a86eef45 [ 712.942788] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.942788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.942788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.942788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.942788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.942788] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1c1d211-a748-4105-a901-9961a86eef45 already deleted. [ 712.943886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1c1d211-a748-4105-a901-9961a86eef45" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.954854] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.955185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.955391] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.955766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.955882] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.958575] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.958575] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.959946] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.960330] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.960996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.961216] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 is going to be created. [ 713.043811] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.043996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.044056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.044299] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.044442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.061766] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 in Status: IN_PROGRESS for 2s [ 713.068773] env[66519]: INFO networking_nsxv3.common.synchronization [None req-7e35155b-5d1a-479c-a932-d09570d2b78e tempest-ServerRescueNegativeTestJSON-912870119 tempest-ServerRescueNegativeTestJSON-912870119-project-member] Enqueued Resource ID: 00c72ce6-74fa-4138-bcac-05408508b67c with Priority: HIGHEST for action security_group_rules [ 713.074144] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00c72ce6-74fa-4138-bcac-05408508b67c with Priority: HIGHEST for action security_group_rules [ 713.074144] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00c72ce6-74fa-4138-bcac-05408508b67c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.074144] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.074144] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.074144] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.074144] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00c72ce6-74fa-4138-bcac-05408508b67c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.384593] env[66519]: INFO networking_nsxv3.common.synchronization [None req-283583bf-6941-4d63-999b-413e71112dbe tempest-ServerRescueNegativeTestJSON-912870119 tempest-ServerRescueNegativeTestJSON-912870119-project-member] Enqueued Resource ID: 00c72ce6-74fa-4138-bcac-05408508b67c with Priority: HIGHEST for action security_group_rules [ 713.385335] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00c72ce6-74fa-4138-bcac-05408508b67c with Priority: HIGHEST for action security_group_rules [ 713.385579] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00c72ce6-74fa-4138-bcac-05408508b67c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.385634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.483321] env[66519]: INFO networking_nsxv3.common.synchronization [req-ed5bf5d3-25a3-4398-b74a-6a9fb2589ae2 req-f0eb8a57-511c-4ff6-ad15-7b830b2e3912 service nova] Enqueued Resource ID: 245777f4-8235-4258-8d94-22f44ade6a9c with Priority: HIGHEST for action security_group_rules [ 713.483321] env[66519]: INFO networking_nsxv3.common.synchronization [req-ed5bf5d3-25a3-4398-b74a-6a9fb2589ae2 req-f0eb8a57-511c-4ff6-ad15-7b830b2e3912 service nova] Enqueued Resource ID: 245777f4-8235-4258-8d94-22f44ade6a9c with Priority: HIGHEST for action security_group_members [ 713.483321] env[66519]: INFO networking_nsxv3.common.synchronization [req-ed5bf5d3-25a3-4398-b74a-6a9fb2589ae2 req-f0eb8a57-511c-4ff6-ad15-7b830b2e3912 service nova] Enqueued Resource ID: fcdcfbea-2009-4f70-996f-1c62b49f2bb0 with Priority: HIGHEST for action port [ 713.483321] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 245777f4-8235-4258-8d94-22f44ade6a9c with Priority: HIGHEST for action security_group_rules [ 713.484433] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 245777f4-8235-4258-8d94-22f44ade6a9c with Priority: HIGHEST for action security_group_members [ 713.488042] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcdcfbea-2009-4f70-996f-1c62b49f2bb0 with Priority: HIGHEST for action port [ 713.488042] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-245777f4-8235-4258-8d94-22f44ade6a9c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.488042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.488042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.488042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.488042] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('245777f4-8235-4258-8d94-22f44ade6a9c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.488042] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-245777f4-8235-4258-8d94-22f44ade6a9c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.488042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.488042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.488042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.488042] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.488042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.488042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.488042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.488042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.488042] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('245777f4-8235-4258-8d94-22f44ade6a9c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.493933] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcdcfbea-2009-4f70-996f-1c62b49f2bb0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.494894] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcdcfbea-2009-4f70-996f-1c62b49f2bb0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.494966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcdcfbea-2009-4f70-996f-1c62b49f2bb0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.495198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcdcfbea-2009-4f70-996f-1c62b49f2bb0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.495789] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcdcfbea-2009-4f70-996f-1c62b49f2bb0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.596053] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.596151] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.596247] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.596491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.596583] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.596685] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00c72ce6-74fa-4138-bcac-05408508b67c already deleted. [ 713.596782] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.596941] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.597175] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.597308] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00c72ce6-74fa-4138-bcac-05408508b67c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.747363] env[66519]: INFO networking_nsxv3.common.synchronization [req-6ea802cc-d2e0-43bc-90c5-6e1112f62b06 req-8c37ef70-e85d-409c-81a0-6057170e2d7f tempest-ImagesNegativeTestJSON-1130211233 tempest-ImagesNegativeTestJSON-1130211233-project-member] Enqueued Resource ID: e0272502-d55a-4dab-9801-a7c27a17a4ef with Priority: HIGHEST for action security_group_members [ 713.748125] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0272502-d55a-4dab-9801-a7c27a17a4ef with Priority: HIGHEST for action security_group_members [ 713.748613] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e0272502-d55a-4dab-9801-a7c27a17a4ef taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.748758] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.748830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.749342] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.749543] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.749852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.749927] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.750105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.750345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.750382] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e0272502-d55a-4dab-9801-a7c27a17a4ef',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.993905] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('245777f4-8235-4258-8d94-22f44ade6a9c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.000338] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-245777f4-8235-4258-8d94-22f44ade6a9c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.000338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.000338] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcdcfbea-2009-4f70-996f-1c62b49f2bb0 with status ACTIVE [ 714.000338] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.000338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.000338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.000338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.000338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.000338] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.000338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.000338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.000338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.000338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.000338] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.001075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.001075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.001075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.001075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.001075] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcdcfbea-2009-4f70-996f-1c62b49f2bb0 is going to be updated. [ 714.039580] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.039724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.039786] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.040017] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.040167] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.040382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcdcfbea-2009-4f70-996f-1c62b49f2bb0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.115238] env[66519]: INFO networking_nsxv3.common.synchronization [req-ad56fba3-dcf7-4020-a093-a7a86db3ea1b req-edcb72a6-31c7-421a-a8c6-76504fde48a6 tempest-ListServerFiltersTestJSON-365692851 tempest-ListServerFiltersTestJSON-365692851-project-member] Enqueued Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_members [ 714.115680] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_members [ 714.116870] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.117127] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.117241] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.117589] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.117844] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.117946] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.118019] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.118197] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.118284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.118383] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.162460] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.162636] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.162675] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.162928] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.162996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.163062] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00c72ce6-74fa-4138-bcac-05408508b67c already deleted. [ 714.163153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.257046] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.257046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.257046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.257046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.257046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.257046] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.257046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.257046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.257046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.257046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.257046] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0272502-d55a-4dab-9801-a7c27a17a4ef is going to be updated. [ 714.273635] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a769e09f-7583-4789-b39d-5853c1dfcd1c in Status: SUCCESS [ 714.273873] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.274092] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.274322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.274526] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.274651] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.274719] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.274884] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.274964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.275065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.275161] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a769e09f-7583-4789-b39d-5853c1dfcd1c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.296784] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.297058] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.297207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.297785] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.297785] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.309242] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0272502-d55a-4dab-9801-a7c27a17a4ef in Status: IN_PROGRESS for 2s [ 714.419822] env[66519]: INFO networking_nsxv3.common.synchronization [req-f1f7ce14-73b0-42fa-94c0-58bea999992c req-765cec31-34aa-4cc5-a0c4-e1735e9e6a67 tempest-ServersTestMultiNic-666815749 tempest-ServersTestMultiNic-666815749-project-member] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 714.420396] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 714.420698] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.420823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.420890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.421323] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.422266] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.422266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.422266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.422266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.422266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.422266] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.497430] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('245777f4-8235-4258-8d94-22f44ade6a9c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.621535] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.621826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.621913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.622238] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.622343] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.622565] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.622678] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.622749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.622984] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.623135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.623281] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8806842e-05bb-42d4-891f-7827a3b60a33 already deleted. [ 714.623444] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.671655] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-575 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.671928] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-575" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.671991] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-575" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.672302] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-575" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.672603] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.672815] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.672933] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.673182] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.673321] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.673529] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.673638] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.673792] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.673962] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.674132] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.674248] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.674379] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.695260] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.695616] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 714.695616] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.695798] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-575" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.696139] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-c5d40896-4e04-42a0-bd15-04a179e4054b taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.696311] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-c5d40896-4e04-42a0-bd15-04a179e4054b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.696452] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-c5d40896-4e04-42a0-bd15-04a179e4054b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.696831] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-c5d40896-4e04-42a0-bd15-04a179e4054b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.698159] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5d40896-4e04-42a0-bd15-04a179e4054b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.777118] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a769e09f-7583-4789-b39d-5853c1dfcd1c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.780195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.780195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.780195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.780195] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.780195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.780195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.780195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.780195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.780195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.780195] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a769e09f-7583-4789-b39d-5853c1dfcd1c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.780195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.780195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.780195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.780969] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.780969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.780969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.780969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.780969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.780969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.780969] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a769e09f-7583-4789-b39d-5853c1dfcd1c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.900956] env[66519]: INFO networking_nsxv3.common.synchronization [req-f1f7ce14-73b0-42fa-94c0-58bea999992c req-58076ce2-7191-4af3-ae54-c0e04f6f5d5f tempest-ServersTestMultiNic-666815749 tempest-ServersTestMultiNic-666815749-project-member] Enqueued Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 714.901516] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac with Priority: HIGHEST for action security_group_members [ 714.902209] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-376a7ea3-3e4d-4872-be2f-8bc029c25fac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.902336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.923716] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.999896] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.000047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.000235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.000334] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.000420] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.000515] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 245777f4-8235-4258-8d94-22f44ade6a9c is going to be created. [ 715.030989] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.031154] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.031261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.031433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.031594] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.043705] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 245777f4-8235-4258-8d94-22f44ade6a9c in Status: UNINITIALIZED for 2s [ 715.074982] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 in Status: SUCCESS [ 715.075412] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.200144] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.200144] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.200144] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.200337] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.200584] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.200676] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port c5d40896-4e04-42a0-bd15-04a179e4054b not found, creating... [ 715.201404] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.201607] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.201775] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.202244] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.202361] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.202661] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.202906] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.203070] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.203406] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.203552] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.203680] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: c5d40896-4e04-42a0-bd15-04a179e4054b is going to be created. [ 715.228186] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.228478] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.228603] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.228883] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.229117] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.229351] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-c5d40896-4e04-42a0-bd15-04a179e4054b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.283156] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a769e09f-7583-4789-b39d-5853c1dfcd1c: rpc.has_security_group_logging(os_id): False [ 715.324801] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.324942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.325022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.325228] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.325315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.325590] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.325692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.325753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.325968] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.326095] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.326304] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.326423] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.326524] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.326717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.326815] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.327023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.327140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.327205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.327353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.327424] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.327507] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a769e09f-7583-4789-b39d-5853c1dfcd1c is going to be created. [ 715.425936] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.442675] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.442675] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.442675] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.442675] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.442895] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.464728] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a769e09f-7583-4789-b39d-5853c1dfcd1c in Status: IN_PROGRESS for 2s [ 715.542438] env[66519]: INFO networking_nsxv3.common.synchronization [req-516efe4c-6fe2-4756-ad87-369eb6736e8d req-0b951848-bdcf-47f8-9c8c-e0483cc55f2d tempest-ImagesOneServerNegativeTestJSON-1631615325 tempest-ImagesOneServerNegativeTestJSON-1631615325-project-member] Enqueued Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_members [ 715.543101] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_members [ 715.543429] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.543554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.543617] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.543883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.544072] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.544179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.544242] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.544403] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.544514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.544616] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.761627] env[66519]: INFO networking_nsxv3.common.synchronization [None req-6ed88896-ecbb-459c-b5be-adb6acea8f25 None None] Enqueued Resource ID: 16f05c7a-6ae8-4541-bbf0-bc019d8d22f7 with Priority: HIGHEST for action port [ 715.762426] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16f05c7a-6ae8-4541-bbf0-bc019d8d22f7 with Priority: HIGHEST for action port [ 715.762872] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-16f05c7a-6ae8-4541-bbf0-bc019d8d22f7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.764697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16f05c7a-6ae8-4541-bbf0-bc019d8d22f7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.764697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16f05c7a-6ae8-4541-bbf0-bc019d8d22f7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.764697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16f05c7a-6ae8-4541-bbf0-bc019d8d22f7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.764697] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16f05c7a-6ae8-4541-bbf0-bc019d8d22f7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.928718] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.928997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.928997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.929224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.929305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.929823] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac is going to be updated. [ 715.964879] env[66519]: INFO networking_nsxv3.common.synchronization [req-ad56fba3-dcf7-4020-a093-a7a86db3ea1b req-88a3d1c4-a4f8-4112-84fd-12736631e4ac service nova] Enqueued Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_rules [ 715.965168] env[66519]: INFO networking_nsxv3.common.synchronization [req-ad56fba3-dcf7-4020-a093-a7a86db3ea1b req-88a3d1c4-a4f8-4112-84fd-12736631e4ac service nova] Enqueued Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_members [ 715.965328] env[66519]: INFO networking_nsxv3.common.synchronization [req-ad56fba3-dcf7-4020-a093-a7a86db3ea1b req-88a3d1c4-a4f8-4112-84fd-12736631e4ac service nova] Enqueued Resource ID: c5d40896-4e04-42a0-bd15-04a179e4054b with Priority: HIGHEST for action port [ 715.965957] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_rules [ 715.968883] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_members [ 715.968883] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5d40896-4e04-42a0-bd15-04a179e4054b with Priority: HIGHEST for action port [ 715.968883] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.968883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.968883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.968883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.968883] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.969497] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.970176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.970176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.970176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.970176] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.970176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.970176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.970432] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.970432] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.970488] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.973638] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5d40896-4e04-42a0-bd15-04a179e4054b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.973638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5d40896-4e04-42a0-bd15-04a179e4054b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.973860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5d40896-4e04-42a0-bd15-04a179e4054b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.973860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5d40896-4e04-42a0-bd15-04a179e4054b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.973977] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5d40896-4e04-42a0-bd15-04a179e4054b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.977411] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.977561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.977662] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.977909] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.978063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.988374] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: IN_PROGRESS for 2s [ 716.048690] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.048690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.048690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.048690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.048690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.048690] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.048690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.048690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.048690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.048690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.048690] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ed5e58-fb42-4430-8674-e9d732009460 is going to be updated. [ 716.081256] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.081256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.081256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.081256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.082055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.093566] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: IN_PROGRESS for 2s [ 716.267163] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16f05c7a-6ae8-4541-bbf0-bc019d8d22f7 [ 716.267843] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.268167] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.268167] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.268398] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.268494] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.268594] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16f05c7a-6ae8-4541-bbf0-bc019d8d22f7 already deleted. [ 716.270406] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16f05c7a-6ae8-4541-bbf0-bc019d8d22f7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.321813] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e0272502-d55a-4dab-9801-a7c27a17a4ef in Status: SUCCESS [ 716.323315] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e0272502-d55a-4dab-9801-a7c27a17a4ef deletion is rescheduled due to dependency. [ 716.323315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e0272502-d55a-4dab-9801-a7c27a17a4ef" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.413600] env[66519]: INFO networking_nsxv3.common.synchronization [req-11342e24-0f6e-4c9e-8581-4fdc405ac61e req-6c6be5a3-34f2-4976-9f38-9bc00d5ef449 tempest-ServerMetadataTestJSON-81765634 tempest-ServerMetadataTestJSON-81765634-project-member] Enqueued Resource ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 with Priority: HIGHEST for action security_group_members [ 716.414394] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 with Priority: HIGHEST for action security_group_members [ 716.414732] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.414863] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.414932] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.415512] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.415839] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.415950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.416059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.416272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.416394] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.416773] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccf6d1d5-d7b2-4eab-a976-db0d74e65462',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.478140] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.478140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.478140] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.479603] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5d40896-4e04-42a0-bd15-04a179e4054b with status ACTIVE [ 716.480374] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.481111] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.481194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.481380] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.481480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.481979] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.482116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.482327] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.482527] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.483691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.483691] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.483869] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.484709] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.484709] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.484709] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.484709] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5d40896-4e04-42a0-bd15-04a179e4054b is going to be updated. [ 716.508998] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.509264] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.509375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.509628] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.509788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.509975] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5d40896-4e04-42a0-bd15-04a179e4054b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.921131] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.921309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.921398] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.921898] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.921898] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.922311] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.922438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.922498] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.922707] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.922825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.923373] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 already deleted. [ 716.923373] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.979676] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.055792] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 245777f4-8235-4258-8d94-22f44ade6a9c in Status: SUCCESS [ 717.056336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.056764] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.057306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.057306] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.057470] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.057617] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.057861] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.058050] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.058220] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.058614] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('245777f4-8235-4258-8d94-22f44ade6a9c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.101720] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-831 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.101720] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-831" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.101720] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-831" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.102082] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-831" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.102293] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.102463] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.102563] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.106034] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.106034] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.106034] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.106034] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.106034] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.106034] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.106034] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.106034] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.106034] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.126135] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.126343] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 717.126503] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.127662] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-831" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.127662] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-df68a546-f4f6-4138-aea0-5c4a523d8faf taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.127662] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-df68a546-f4f6-4138-aea0-5c4a523d8faf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.127662] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-df68a546-f4f6-4138-aea0-5c4a523d8faf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.128207] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-df68a546-f4f6-4138-aea0-5c4a523d8faf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.128207] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df68a546-f4f6-4138-aea0-5c4a523d8faf',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.479582] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a769e09f-7583-4789-b39d-5853c1dfcd1c in Status: SUCCESS [ 717.479972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.482967] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.483546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.483546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.483955] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.483955] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.484112] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8806842e-05bb-42d4-891f-7827a3b60a33 is going to be created. [ 717.513890] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.513890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.513890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.514188] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.514351] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.525891] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: UNINITIALIZED for 2s [ 717.561617] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('245777f4-8235-4258-8d94-22f44ade6a9c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.631023] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.631239] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.631308] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.631638] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.631729] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.632098] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port df68a546-f4f6-4138-aea0-5c4a523d8faf not found, creating... [ 717.632501] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.632947] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.632947] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.633051] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.633180] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.633484] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.633677] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.634221] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.634592] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.634999] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.634999] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: df68a546-f4f6-4138-aea0-5c4a523d8faf is going to be created. [ 717.664028] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.664028] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.664028] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.664028] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.664028] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.664356] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-df68a546-f4f6-4138-aea0-5c4a523d8faf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.003484] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: SUCCESS [ 718.003869] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.005191] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.005828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.005828] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.005828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.005991] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.006121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.006220] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.006371] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('376a7ea3-3e4d-4872-be2f-8bc029c25fac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.064332] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 245777f4-8235-4258-8d94-22f44ade6a9c: rpc.has_security_group_logging(os_id): False [ 718.087731] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.087888] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.087888] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.088151] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.088264] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.089586] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.089586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.089586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.089586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.089586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.089586] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 245777f4-8235-4258-8d94-22f44ade6a9c is going to be created. [ 718.102518] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: SUCCESS [ 718.102964] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ed5e58-fb42-4430-8674-e9d732009460 deletion is rescheduled due to dependency. [ 718.102964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.165284] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.165768] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.165768] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.165920] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.166177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.183245] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 245777f4-8235-4258-8d94-22f44ade6a9c in Status: IN_PROGRESS for 2s [ 718.460063] env[66519]: INFO networking_nsxv3.common.synchronization [req-11342e24-0f6e-4c9e-8581-4fdc405ac61e req-eb210908-5a27-4f03-8fdc-f3fbfec02b2b service nova] Enqueued Resource ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 with Priority: HIGHEST for action security_group_rules [ 718.460063] env[66519]: INFO networking_nsxv3.common.synchronization [req-11342e24-0f6e-4c9e-8581-4fdc405ac61e req-eb210908-5a27-4f03-8fdc-f3fbfec02b2b service nova] Enqueued Resource ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 with Priority: HIGHEST for action security_group_members [ 718.460063] env[66519]: INFO networking_nsxv3.common.synchronization [req-11342e24-0f6e-4c9e-8581-4fdc405ac61e req-eb210908-5a27-4f03-8fdc-f3fbfec02b2b service nova] Enqueued Resource ID: df68a546-f4f6-4138-aea0-5c4a523d8faf with Priority: HIGHEST for action port [ 718.461053] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 with Priority: HIGHEST for action security_group_rules [ 718.461334] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 with Priority: HIGHEST for action security_group_members [ 718.461545] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df68a546-f4f6-4138-aea0-5c4a523d8faf with Priority: HIGHEST for action port [ 718.462159] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccf6d1d5-d7b2-4eab-a976-db0d74e65462 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.462698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.465222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.465222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.465222] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccf6d1d5-d7b2-4eab-a976-db0d74e65462',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.465222] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.465222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.465222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.465222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.465825] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.466057] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.466206] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.466463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.466989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.467290] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccf6d1d5-d7b2-4eab-a976-db0d74e65462',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.470182] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-df68a546-f4f6-4138-aea0-5c4a523d8faf taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.470182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df68a546-f4f6-4138-aea0-5c4a523d8faf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.470182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df68a546-f4f6-4138-aea0-5c4a523d8faf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.470182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df68a546-f4f6-4138-aea0-5c4a523d8faf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.470182] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df68a546-f4f6-4138-aea0-5c4a523d8faf',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.510754] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.511032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.511097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.511287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.511409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.511643] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.511761] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.511852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.512048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.512162] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.512397] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac is going to be updated. [ 718.546495] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.546752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.546975] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.547083] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.547266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.561540] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: IN_PROGRESS for 2s [ 718.971964] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccf6d1d5-d7b2-4eab-a976-db0d74e65462',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.973385] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.973385] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.973385] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df68a546-f4f6-4138-aea0-5c4a523d8faf with status ACTIVE [ 718.973551] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.973652] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.973720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.973922] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.974028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.974190] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.974286] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.974344] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.974491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.974567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.974739] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.974828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.974888] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.976212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.976353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.976453] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df68a546-f4f6-4138-aea0-5c4a523d8faf is going to be updated. [ 719.027745] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.028227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.028227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.028703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.028703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.028781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df68a546-f4f6-4138-aea0-5c4a523d8faf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.345161] env[66519]: INFO networking_nsxv3.common.synchronization [req-1e90ae13-62ea-4ef6-847e-d5e85ca9f2ee req-66ac76a0-97d2-4889-8e9d-9cd68cb22282 tempest-ImagesTestJSON-1420515381 tempest-ImagesTestJSON-1420515381-project-member] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 719.345821] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 719.347222] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.347222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.347222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.347222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.347426] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.347426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.347521] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.350078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.350078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.350078] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.480176] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccf6d1d5-d7b2-4eab-a976-db0d74e65462',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.543054] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: SUCCESS [ 719.543277] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.543566] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.543823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.543984] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.544158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.544206] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.544826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.544980] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.545164] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.545282] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.851610] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.851610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.851610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.851610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.851887] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.851887] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.851990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.852111] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.852226] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.852300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.852381] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 already deleted. [ 719.852460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.871852] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-161 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.871962] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.872156] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.872530] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.872793] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.872949] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.873071] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.873288] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.873432] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.873746] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 719.873811] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 719.873931] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 719.874096] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 719.874211] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 719.874323] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 719.874526] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 719.900372] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 719.900583] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 719.900709] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 719.900910] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.901462] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-a79d9900-a673-4458-9b51-1993c056cf9b taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.901874] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-a79d9900-a673-4458-9b51-1993c056cf9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.901874] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-a79d9900-a673-4458-9b51-1993c056cf9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.903745] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-a79d9900-a673-4458-9b51-1993c056cf9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.903882] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a79d9900-a673-4458-9b51-1993c056cf9b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.984397] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.984587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.984587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.984827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.984891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.984995] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 is going to be created. [ 720.016039] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.016039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.016039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.016243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.016278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.027328] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 in Status: UNINITIALIZED for 2s [ 720.048091] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.048563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.048563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.048639] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.048830] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.049011] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.049131] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.049362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.049487] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.049586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.049881] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.049984] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.050068] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.050275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.050857] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.050857] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.050857] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.050993] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.050993] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.051122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.051256] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.197064] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 245777f4-8235-4258-8d94-22f44ade6a9c in Status: SUCCESS [ 720.197064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.406872] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.407088] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.407213] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.407502] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.407649] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.407850] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port a79d9900-a673-4458-9b51-1993c056cf9b not found, creating... [ 720.408144] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.408301] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.408415] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.408633] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.408763] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.409052] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.409212] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.409311] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.409517] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.409671] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.409774] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: a79d9900-a673-4458-9b51-1993c056cf9b is going to be created. [ 720.431117] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.431342] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.431443] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.431733] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.431976] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.432642] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-a79d9900-a673-4458-9b51-1993c056cf9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.557759] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8806842e-05bb-42d4-891f-7827a3b60a33: rpc.has_security_group_logging(os_id): False [ 720.576819] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac in Status: SUCCESS [ 720.577149] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 376a7ea3-3e4d-4872-be2f-8bc029c25fac deletion is rescheduled due to dependency. [ 720.577309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-376a7ea3-3e4d-4872-be2f-8bc029c25fac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.619860] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.619860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.619860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.620147] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.620147] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.621231] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.621231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.621231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.621231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.621231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.621231] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.621231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.621971] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.621971] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.621971] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.622091] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.622136] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.622209] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.622357] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.622456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.622632] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8806842e-05bb-42d4-891f-7827a3b60a33 is going to be created. [ 720.720475] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.722121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.722121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.722121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.722121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.733771] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: IN_PROGRESS for 2s [ 721.724895] env[66519]: INFO networking_nsxv3.common.synchronization [req-1e90ae13-62ea-4ef6-847e-d5e85ca9f2ee req-11046c43-ddb6-4625-933b-1f93c125c58f service nova] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_rules [ 721.724895] env[66519]: INFO networking_nsxv3.common.synchronization [req-1e90ae13-62ea-4ef6-847e-d5e85ca9f2ee req-11046c43-ddb6-4625-933b-1f93c125c58f service nova] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 721.724895] env[66519]: INFO networking_nsxv3.common.synchronization [req-1e90ae13-62ea-4ef6-847e-d5e85ca9f2ee req-11046c43-ddb6-4625-933b-1f93c125c58f service nova] Enqueued Resource ID: a79d9900-a673-4458-9b51-1993c056cf9b with Priority: HIGHEST for action port [ 721.728421] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_rules [ 721.728421] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 721.728421] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79d9900-a673-4458-9b51-1993c056cf9b with Priority: HIGHEST for action port [ 721.728421] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.728421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.728421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.728421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.729073] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.731306] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.731306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.731306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.731306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.731306] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.731306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.731306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.731306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.731306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.732287] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.733909] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-a79d9900-a673-4458-9b51-1993c056cf9b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.733909] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a79d9900-a673-4458-9b51-1993c056cf9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.733909] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a79d9900-a673-4458-9b51-1993c056cf9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.733909] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a79d9900-a673-4458-9b51-1993c056cf9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.733909] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a79d9900-a673-4458-9b51-1993c056cf9b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.041958] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 in Status: SUCCESS [ 722.042486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.042815] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.043177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.043479] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.043623] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.043729] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.043962] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.044218] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.044420] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.044626] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ccf6d1d5-d7b2-4eab-a976-db0d74e65462',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.231367] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.231557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.234116] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.235251] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a79d9900-a673-4458-9b51-1993c056cf9b with status ACTIVE [ 722.235383] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.237072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.237072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.237072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.237072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.237072] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.237072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.237072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.237072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.237072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.237072] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.237072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.237072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.237072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.237900] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.237900] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a79d9900-a673-4458-9b51-1993c056cf9b is going to be updated. [ 722.278551] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.278551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.278551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.278838] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.279039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.279306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a79d9900-a673-4458-9b51-1993c056cf9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.550282] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.550462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.550536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.550767] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.550965] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.551098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.551169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.551348] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.551436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.551527] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.551697] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.551792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.551858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.552045] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.552177] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.552287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.552355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.552609] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.552712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.552799] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.552908] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ccf6d1d5-d7b2-4eab-a976-db0d74e65462',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.739827] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.752449] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: SUCCESS [ 722.752449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.056944] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ccf6d1d5-d7b2-4eab-a976-db0d74e65462: rpc.has_security_group_logging(os_id): False [ 723.086274] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.088216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.088216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.088216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.088216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.088216] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.088216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.088216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.088216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.088216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.088216] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.088216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.088216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.088216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.088216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.089198] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.089198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.089198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.089198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.089198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.091133] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 is going to be created. [ 723.194843] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.195095] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.195169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.195570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.195789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.216781] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 in Status: IN_PROGRESS for 2s [ 723.250229] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.250229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.250578] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.250578] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.251230] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.251402] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be created. [ 723.303453] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.305323] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.305323] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.305323] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.305323] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.336850] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: UNINITIALIZED for 2s [ 725.230999] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 in Status: SUCCESS [ 725.231331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.432703] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: SUCCESS [ 725.436165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.436165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.436165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.436165] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.436165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.436165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.436165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.436165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.436165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.436165] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.940203] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.940412] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.940491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.940736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.940914] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.941066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.941162] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.941406] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.941501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.941611] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.941809] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.941962] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.942055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.942250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.942401] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.942544] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.942590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.942771] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.943551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.943684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.943810] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.446109] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c93d149b-db2a-420d-81f5-177c6bdd9505: rpc.has_security_group_logging(os_id): False [ 726.467916] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.468621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.468757] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.469014] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.469735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.469735] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.470207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.470207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.470687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.470687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.470889] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.471045] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.471114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.471314] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.471422] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.471678] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.471809] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.471951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.472309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.472488] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.472569] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be created. [ 726.540553] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.540719] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.540789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.541028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.543098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.563192] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: IN_PROGRESS for 2s [ 726.729650] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 726.730137] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 727.108999] env[66519]: INFO networking_nsxv3.common.synchronization [req-70f1eb97-dd7d-47a3-b21b-d364b7c69ed4 req-2750aeff-28aa-4181-a174-ce4cfb50da67 tempest-InstanceActionsV221TestJSON-1179840958 tempest-InstanceActionsV221TestJSON-1179840958-project-member] Enqueued Resource ID: a769e09f-7583-4789-b39d-5853c1dfcd1c with Priority: HIGHEST for action security_group_members [ 727.110144] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a769e09f-7583-4789-b39d-5853c1dfcd1c with Priority: HIGHEST for action security_group_members [ 727.110468] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a769e09f-7583-4789-b39d-5853c1dfcd1c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.110607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.110683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.110923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.111759] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.112701] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.112701] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.112701] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.112701] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.112701] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a769e09f-7583-4789-b39d-5853c1dfcd1c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.616713] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.617217] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.617217] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.617372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.617482] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.617753] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.617909] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.617975] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.618170] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.618250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.618357] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a769e09f-7583-4789-b39d-5853c1dfcd1c is going to be updated. [ 727.653355] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.655836] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.655836] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.655836] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.655836] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.667366] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a769e09f-7583-4789-b39d-5853c1dfcd1c in Status: IN_PROGRESS for 2s [ 728.579430] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: SUCCESS [ 728.579771] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.510748] env[66519]: INFO networking_nsxv3.common.synchronization [req-e0aeba40-f53b-40dc-b74f-ef6bae806f98 req-3ac3b9f3-1e62-4902-9b8d-f49fa730f02a tempest-ServersAdminNegativeTestJSON-1811417065 tempest-ServersAdminNegativeTestJSON-1811417065-project-member] Enqueued Resource ID: 820ceacd-99d3-4034-aaf8-315de338869a with Priority: HIGHEST for action security_group_members [ 729.510748] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820ceacd-99d3-4034-aaf8-315de338869a with Priority: HIGHEST for action security_group_members [ 729.512102] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-820ceacd-99d3-4034-aaf8-315de338869a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.512426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.512625] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.513275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.513687] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.514029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.514186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.514444] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.514750] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.514953] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.679669] env[66519]: INFO networking_nsxv3.common.synchronization [req-e487c45a-d15e-4c7e-a514-81c825d5bfe0 req-a1e51c39-d8a8-4ea4-b1e9-81c0fc60921f tempest-ListServerFiltersTestJSON-365692851 tempest-ListServerFiltersTestJSON-365692851-project-member] Enqueued Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_members [ 729.680788] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a769e09f-7583-4789-b39d-5853c1dfcd1c in Status: SUCCESS [ 729.681279] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a769e09f-7583-4789-b39d-5853c1dfcd1c deletion is rescheduled due to dependency. [ 729.682048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.683194] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_members [ 729.683684] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.683874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.684020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.684355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.684628] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.685145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.685145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.685145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.685380] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.685564] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.002187] env[66519]: INFO networking_nsxv3.common.synchronization [None req-6dac169b-ca42-45cb-acf9-877408dfb6b7 None None] Enqueued Resource ID: b3ccbae6-9ec6-469e-99cc-da44ae898e99 with Priority: HIGHEST for action port [ 730.002945] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3ccbae6-9ec6-469e-99cc-da44ae898e99 with Priority: HIGHEST for action port [ 730.003305] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3ccbae6-9ec6-469e-99cc-da44ae898e99 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.003469] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3ccbae6-9ec6-469e-99cc-da44ae898e99" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.003583] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3ccbae6-9ec6-469e-99cc-da44ae898e99" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.003985] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3ccbae6-9ec6-469e-99cc-da44ae898e99" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.004155] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3ccbae6-9ec6-469e-99cc-da44ae898e99',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.017039] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.144845] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-575 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.144845] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-575" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.144845] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-575" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.144845] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-575" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.144845] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.144845] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.144845] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.144845] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.145273] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.145304] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.145615] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 730.145857] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 730.146106] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 730.146370] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.146624] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 730.146911] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 730.170316] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 730.170497] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 730.170684] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 730.171155] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-575" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.171509] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-d63c360b-57a4-4fa5-a0c5-2149a44b099a taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.171690] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-d63c360b-57a4-4fa5-a0c5-2149a44b099a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.171784] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-d63c360b-57a4-4fa5-a0c5-2149a44b099a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.172116] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-d63c360b-57a4-4fa5-a0c5-2149a44b099a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.172247] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d63c360b-57a4-4fa5-a0c5-2149a44b099a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.188965] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.508571] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3ccbae6-9ec6-469e-99cc-da44ae898e99 [ 730.508571] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.508571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.508571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.508571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.508571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.508571] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3ccbae6-9ec6-469e-99cc-da44ae898e99 already deleted. [ 730.508571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3ccbae6-9ec6-469e-99cc-da44ae898e99" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.520436] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.674737] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.674937] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.675101] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.675605] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.675605] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.675775] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port d63c360b-57a4-4fa5-a0c5-2149a44b099a not found, creating... [ 730.676646] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.676646] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.676646] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.676646] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.676875] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.676998] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.679178] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.679250] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.679542] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.680189] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.681129] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: d63c360b-57a4-4fa5-a0c5-2149a44b099a is going to be created. [ 730.692254] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.712632] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.712847] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.714021] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.714021] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.714021] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.714021] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-d63c360b-57a4-4fa5-a0c5-2149a44b099a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.022664] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.022870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.022936] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.023123] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.023231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.023305] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 820ceacd-99d3-4034-aaf8-315de338869a is going to be updated. [ 731.052433] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.052592] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.052667] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.052859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.053015] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.064035] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820ceacd-99d3-4034-aaf8-315de338869a in Status: IN_PROGRESS for 2s [ 731.198066] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.198066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.198066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.198066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.198066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.198066] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8806842e-05bb-42d4-891f-7827a3b60a33 is going to be updated. [ 731.229494] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.229656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.229707] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.229948] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.230109] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.239686] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: IN_PROGRESS for 2s [ 731.449112] env[66519]: INFO networking_nsxv3.common.synchronization [req-e487c45a-d15e-4c7e-a514-81c825d5bfe0 req-f952b651-1f1a-42d7-a6b2-d9547f89ef00 service nova] Enqueued Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_rules [ 731.449306] env[66519]: INFO networking_nsxv3.common.synchronization [req-e487c45a-d15e-4c7e-a514-81c825d5bfe0 req-f952b651-1f1a-42d7-a6b2-d9547f89ef00 service nova] Enqueued Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_members [ 731.449437] env[66519]: INFO networking_nsxv3.common.synchronization [req-e487c45a-d15e-4c7e-a514-81c825d5bfe0 req-f952b651-1f1a-42d7-a6b2-d9547f89ef00 service nova] Enqueued Resource ID: d63c360b-57a4-4fa5-a0c5-2149a44b099a with Priority: HIGHEST for action port [ 731.451464] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_rules [ 731.451678] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_members [ 731.451734] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d63c360b-57a4-4fa5-a0c5-2149a44b099a with Priority: HIGHEST for action port [ 731.452631] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.452631] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.452631] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.452631] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.452631] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.453642] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.453642] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.454060] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-d63c360b-57a4-4fa5-a0c5-2149a44b099a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.454060] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d63c360b-57a4-4fa5-a0c5-2149a44b099a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.454060] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d63c360b-57a4-4fa5-a0c5-2149a44b099a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.454215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d63c360b-57a4-4fa5-a0c5-2149a44b099a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.454215] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d63c360b-57a4-4fa5-a0c5-2149a44b099a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.956233] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.956535] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.956590] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d63c360b-57a4-4fa5-a0c5-2149a44b099a with status ACTIVE [ 731.956760] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.956915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.957047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.957195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.957855] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.957855] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.957855] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.957855] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.957855] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.957855] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.958122] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.958122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.958236] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.958369] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.959533] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.960072] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d63c360b-57a4-4fa5-a0c5-2149a44b099a is going to be updated. [ 731.984521] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.985456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.985456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.986351] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.986594] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.986722] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d63c360b-57a4-4fa5-a0c5-2149a44b099a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.757143] env[66519]: INFO networking_nsxv3.common.synchronization [None req-59cb8f5a-63a4-4665-99fe-d8ce99c131ca None None] Enqueued Resource ID: 0f2525e5-7c21-45df-864b-7d543a1f63ba with Priority: HIGHEST for action port [ 732.757846] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2525e5-7c21-45df-864b-7d543a1f63ba with Priority: HIGHEST for action port [ 732.758180] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f2525e5-7c21-45df-864b-7d543a1f63ba taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.758310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f2525e5-7c21-45df-864b-7d543a1f63ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.758373] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f2525e5-7c21-45df-864b-7d543a1f63ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.758606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f2525e5-7c21-45df-864b-7d543a1f63ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.758685] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f2525e5-7c21-45df-864b-7d543a1f63ba',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.075267] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820ceacd-99d3-4034-aaf8-315de338869a in Status: SUCCESS [ 733.075267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.250185] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: SUCCESS [ 733.250407] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.250583] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.250819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.251013] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.251136] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.251199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.251352] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.251433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.251528] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.261013] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f2525e5-7c21-45df-864b-7d543a1f63ba [ 733.261801] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.262077] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.262152] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.263195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.263195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.263195] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f2525e5-7c21-45df-864b-7d543a1f63ba already deleted. [ 733.263195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f2525e5-7c21-45df-864b-7d543a1f63ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.754492] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.257595] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.696402] env[66519]: INFO networking_nsxv3.common.synchronization [None req-2ac803e9-545a-4f2b-80d3-c1717c88661c None None] Enqueued Resource ID: 32b5a97d-38e3-4f7b-99d5-d9d0cf633d36 with Priority: HIGHEST for action port [ 734.699724] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32b5a97d-38e3-4f7b-99d5-d9d0cf633d36 with Priority: HIGHEST for action port [ 734.699724] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-32b5a97d-38e3-4f7b-99d5-d9d0cf633d36 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.699724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32b5a97d-38e3-4f7b-99d5-d9d0cf633d36" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.699724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32b5a97d-38e3-4f7b-99d5-d9d0cf633d36" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.699724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32b5a97d-38e3-4f7b-99d5-d9d0cf633d36" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.699724] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32b5a97d-38e3-4f7b-99d5-d9d0cf633d36',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.763383] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.763383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.763383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.763383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.763383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.763383] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8806842e-05bb-42d4-891f-7827a3b60a33 is going to be updated. [ 734.797326] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.797519] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.797519] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.797665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.797826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.807619] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: IN_PROGRESS for 2s [ 735.202756] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32b5a97d-38e3-4f7b-99d5-d9d0cf633d36 [ 735.203094] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.203422] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.203547] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.203964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.204127] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.205227] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32b5a97d-38e3-4f7b-99d5-d9d0cf633d36 already deleted. [ 735.205227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32b5a97d-38e3-4f7b-99d5-d9d0cf633d36" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.820024] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: SUCCESS [ 736.820024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.820024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.820429] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.820429] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.820515] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.820515] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.820653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.820733] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.820818] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.820915] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.157716] env[66519]: INFO networking_nsxv3.common.synchronization [None req-925d9dd6-627d-45f5-8c59-b7ba9f30bd7c None None] Enqueued Resource ID: 799988b6-a07a-4a13-855e-6df62d5c7ea5 with Priority: HIGHEST for action port [ 737.159430] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 799988b6-a07a-4a13-855e-6df62d5c7ea5 with Priority: HIGHEST for action port [ 737.159682] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-799988b6-a07a-4a13-855e-6df62d5c7ea5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.161626] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-799988b6-a07a-4a13-855e-6df62d5c7ea5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.161626] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-799988b6-a07a-4a13-855e-6df62d5c7ea5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.161626] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-799988b6-a07a-4a13-855e-6df62d5c7ea5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.161626] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('799988b6-a07a-4a13-855e-6df62d5c7ea5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.323362] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.324443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.324579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.325236] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.326200] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.326200] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.326200] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.326570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.327702] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.327989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.328399] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.328602] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.328672] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.329225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.332218] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.332330] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.332396] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.332550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.332633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.332718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.332811] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.626242] env[66519]: INFO networking_nsxv3.common.synchronization [None req-327a5c8f-4984-4aef-82bc-29442f277396 None None] Enqueued Resource ID: c0b3eb55-2c65-461c-84be-9682c7a608e2 with Priority: HIGHEST for action port [ 737.626823] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0b3eb55-2c65-461c-84be-9682c7a608e2 with Priority: HIGHEST for action port [ 737.628960] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0b3eb55-2c65-461c-84be-9682c7a608e2 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.629319] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0b3eb55-2c65-461c-84be-9682c7a608e2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.629430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0b3eb55-2c65-461c-84be-9682c7a608e2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.629710] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0b3eb55-2c65-461c-84be-9682c7a608e2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.630450] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0b3eb55-2c65-461c-84be-9682c7a608e2',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.666209] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 799988b6-a07a-4a13-855e-6df62d5c7ea5 [ 737.666431] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.666559] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.666624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.666851] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.667041] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.667041] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:799988b6-a07a-4a13-855e-6df62d5c7ea5 already deleted. [ 737.667120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-799988b6-a07a-4a13-855e-6df62d5c7ea5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.835437] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8806842e-05bb-42d4-891f-7827a3b60a33: rpc.has_security_group_logging(os_id): False [ 737.856023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.856023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.856023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.856023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.856023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.856023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.856023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.856023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.856023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.856023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.856023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.856023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.856587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.856587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.856587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.856587] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.856587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.856741] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.856784] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.857840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.859223] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8806842e-05bb-42d4-891f-7827a3b60a33 is going to be updated. [ 737.923372] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.923372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.923372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.923372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.923604] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.939434] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: IN_PROGRESS for 2s [ 738.133084] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0b3eb55-2c65-461c-84be-9682c7a608e2 [ 738.133373] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.133527] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.133606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.133923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.134091] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.134222] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0b3eb55-2c65-461c-84be-9682c7a608e2 already deleted. [ 738.134354] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0b3eb55-2c65-461c-84be-9682c7a608e2" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.850288] env[66519]: INFO networking_nsxv3.common.synchronization [req-bf300bf9-366b-46ac-bbe3-075ba9affe05 req-b3cd193f-3c21-47e2-a6d5-4e30b67e5814 tempest-ListServerFiltersTestJSON-365692851 tempest-ListServerFiltersTestJSON-365692851-project-member] Enqueued Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_members [ 738.850841] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_members [ 738.851197] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.851322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.851385] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.851831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.851831] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.853552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.853552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.853552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.853552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.853552] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.256254] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-575 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.256254] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-575" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.256439] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-575" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.256686] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-575" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.256932] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.257098] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.257238] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.258065] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.258065] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.258065] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.258065] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.258065] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.258065] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.258329] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.258329] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.258387] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.281988] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.283034] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 739.283034] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.283034] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-575" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.283034] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-db315f11-04cf-4128-8c9a-4ba3a473453c taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.283034] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-db315f11-04cf-4128-8c9a-4ba3a473453c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.283034] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-db315f11-04cf-4128-8c9a-4ba3a473453c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.283350] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-db315f11-04cf-4128-8c9a-4ba3a473453c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.284025] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db315f11-04cf-4128-8c9a-4ba3a473453c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.355187] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.786047] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.786407] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.786634] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.787063] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.787414] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.787582] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port db315f11-04cf-4128-8c9a-4ba3a473453c not found, creating... [ 739.788026] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.788301] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.788502] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.789212] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.789212] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.789821] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.789821] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.790043] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.790439] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.790566] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.790799] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: db315f11-04cf-4128-8c9a-4ba3a473453c is going to be created. [ 739.830261] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.831061] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.831061] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.831288] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.831669] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.834468] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-db315f11-04cf-4128-8c9a-4ba3a473453c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.860848] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.965025] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: SUCCESS [ 739.965795] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.338435] env[66519]: INFO networking_nsxv3.common.synchronization [None req-df6eb115-697b-4f90-ba1e-68843145d959 None None] Enqueued Resource ID: db91cb69-96e8-4881-bfc5-a9fb5c526493 with Priority: HIGHEST for action port [ 740.339090] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db91cb69-96e8-4881-bfc5-a9fb5c526493 with Priority: HIGHEST for action port [ 740.339468] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-db91cb69-96e8-4881-bfc5-a9fb5c526493 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.339814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db91cb69-96e8-4881-bfc5-a9fb5c526493" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.339814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db91cb69-96e8-4881-bfc5-a9fb5c526493" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.339973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db91cb69-96e8-4881-bfc5-a9fb5c526493" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.340055] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db91cb69-96e8-4881-bfc5-a9fb5c526493',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.362420] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.363255] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.363255] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.363255] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.363416] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.363416] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8806842e-05bb-42d4-891f-7827a3b60a33 is going to be updated. [ 740.396687] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.396687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.396687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.396856] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.396957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.407331] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: IN_PROGRESS for 2s [ 740.529053] env[66519]: INFO networking_nsxv3.common.synchronization [req-bf300bf9-366b-46ac-bbe3-075ba9affe05 req-9d79d4cd-9602-4aaf-b328-b488090a6403 service nova] Enqueued Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_rules [ 740.529126] env[66519]: INFO networking_nsxv3.common.synchronization [req-bf300bf9-366b-46ac-bbe3-075ba9affe05 req-9d79d4cd-9602-4aaf-b328-b488090a6403 service nova] Enqueued Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_members [ 740.529251] env[66519]: INFO networking_nsxv3.common.synchronization [req-bf300bf9-366b-46ac-bbe3-075ba9affe05 req-9d79d4cd-9602-4aaf-b328-b488090a6403 service nova] Enqueued Resource ID: db315f11-04cf-4128-8c9a-4ba3a473453c with Priority: HIGHEST for action port [ 740.529856] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_rules [ 740.529979] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_members [ 740.530067] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db315f11-04cf-4128-8c9a-4ba3a473453c with Priority: HIGHEST for action port [ 740.530552] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.530665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.530754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.530927] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.531009] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.532594] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.532652] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.532877] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-db315f11-04cf-4128-8c9a-4ba3a473453c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.532989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db315f11-04cf-4128-8c9a-4ba3a473453c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.533110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db315f11-04cf-4128-8c9a-4ba3a473453c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.533277] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db315f11-04cf-4128-8c9a-4ba3a473453c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.533367] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db315f11-04cf-4128-8c9a-4ba3a473453c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.842479] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db91cb69-96e8-4881-bfc5-a9fb5c526493 [ 740.842792] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.843305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.843385] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.843736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.843811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.843865] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db91cb69-96e8-4881-bfc5-a9fb5c526493 already deleted. [ 740.843935] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db91cb69-96e8-4881-bfc5-a9fb5c526493" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.035668] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.035943] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.035982] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db315f11-04cf-4128-8c9a-4ba3a473453c with status ACTIVE [ 741.036315] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.036315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.036448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.036897] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.036897] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.036897] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.036897] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.037096] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.037130] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.037240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.037360] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.037448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.037507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.037642] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.037708] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.037787] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db315f11-04cf-4128-8c9a-4ba3a473453c is going to be updated. [ 741.062501] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.062501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.062501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.062501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.062501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.062501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db315f11-04cf-4128-8c9a-4ba3a473453c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.378203] env[66519]: INFO networking_nsxv3.common.synchronization [None req-779bc23f-bf0d-47de-acf7-8f8910e9afcc tempest-ServersV294TestFqdnHostnames-1610063464 tempest-ServersV294TestFqdnHostnames-1610063464-project-member] Enqueued Resource ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 with Priority: HIGHEST for action security_group_rules [ 741.378720] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 with Priority: HIGHEST for action security_group_rules [ 741.379029] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b539ffb-57a2-420e-8eb3-8a80c9021bc6 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.379153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.379219] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.379457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.379540] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b539ffb-57a2-420e-8eb3-8a80c9021bc6',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.630593] env[66519]: INFO networking_nsxv3.common.synchronization [req-94fb6def-4924-49ae-9ebe-e509453a313f req-6054a8a3-6d9a-4a20-bffa-2157e6437240 tempest-ServersNegativeTestJSON-375310877 tempest-ServersNegativeTestJSON-375310877-project-member] Enqueued Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_members [ 741.631223] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_members [ 741.633882] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.635419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.635419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.635419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.635773] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.635773] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.636025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.636025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.636110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.636151] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.799817] env[66519]: INFO networking_nsxv3.common.synchronization [None req-3e04e28f-9d68-4115-b8cc-1614aae34f26 tempest-ServersV294TestFqdnHostnames-1610063464 tempest-ServersV294TestFqdnHostnames-1610063464-project-member] Enqueued Resource ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 with Priority: HIGHEST for action security_group_rules [ 741.799817] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 with Priority: HIGHEST for action security_group_rules [ 741.799817] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b539ffb-57a2-420e-8eb3-8a80c9021bc6 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.799817] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.900444] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.900575] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.900619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.900840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.900930] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.901298] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 already deleted. [ 741.901428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.901592] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.901767] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.901829] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b539ffb-57a2-420e-8eb3-8a80c9021bc6',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.121424] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.121837] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-887" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.121894] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-887" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.122594] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-887" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.122889] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.123067] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.123174] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.123398] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.123534] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.123768] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.123903] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.124020] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.124111] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.124234] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.124335] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.124457] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.146259] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.146259] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 742.146259] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.146517] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-887" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.147157] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-53bc37f7-2108-4d37-a1d0-082b0539da45 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.148058] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-53bc37f7-2108-4d37-a1d0-082b0539da45" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.148058] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-53bc37f7-2108-4d37-a1d0-082b0539da45" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.148058] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-53bc37f7-2108-4d37-a1d0-082b0539da45" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.148058] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53bc37f7-2108-4d37-a1d0-082b0539da45',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.149028] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.417042] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: SUCCESS [ 742.417042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.417216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.417296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.417481] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.417597] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.417653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.417800] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.417948] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.418018] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.423238] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.423365] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.423462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.423692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.423692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.423789] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 already deleted. [ 742.423852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.651404] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.652751] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.652949] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.653157] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.653459] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.653643] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.653816] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 53bc37f7-2108-4d37-a1d0-082b0539da45 not found, creating... [ 742.654101] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.654281] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.654411] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.654614] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.654760] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.655022] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.655276] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.655413] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.655675] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.655836] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.656009] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 53bc37f7-2108-4d37-a1d0-082b0539da45 is going to be created. [ 742.678788] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.679014] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.679116] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.679383] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.679593] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.679829] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-53bc37f7-2108-4d37-a1d0-082b0539da45" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.920401] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.158689] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.158990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.159046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.159417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.159417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.159544] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f825e83f-7046-4bbd-969b-a037ace80c92 is going to be updated. [ 743.191913] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.192173] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.192173] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.192363] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.192514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.204303] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: IN_PROGRESS for 2s [ 743.423276] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.453951] env[66519]: INFO networking_nsxv3.common.synchronization [req-94fb6def-4924-49ae-9ebe-e509453a313f req-c62d9cd6-bdc5-4163-8e88-8720290588b5 service nova] Enqueued Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_rules [ 743.454124] env[66519]: INFO networking_nsxv3.common.synchronization [req-94fb6def-4924-49ae-9ebe-e509453a313f req-c62d9cd6-bdc5-4163-8e88-8720290588b5 service nova] Enqueued Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_members [ 743.454692] env[66519]: INFO networking_nsxv3.common.synchronization [req-94fb6def-4924-49ae-9ebe-e509453a313f req-c62d9cd6-bdc5-4163-8e88-8720290588b5 service nova] Enqueued Resource ID: 53bc37f7-2108-4d37-a1d0-082b0539da45 with Priority: HIGHEST for action port [ 743.454692] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_rules [ 743.454910] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_members [ 743.455054] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53bc37f7-2108-4d37-a1d0-082b0539da45 with Priority: HIGHEST for action port [ 743.455321] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.455435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.455494] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.455766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.455841] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.456896] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.457100] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.458084] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-53bc37f7-2108-4d37-a1d0-082b0539da45 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.458084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53bc37f7-2108-4d37-a1d0-082b0539da45" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.458084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53bc37f7-2108-4d37-a1d0-082b0539da45" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.458084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53bc37f7-2108-4d37-a1d0-082b0539da45" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.458084] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53bc37f7-2108-4d37-a1d0-082b0539da45',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.927130] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.927130] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.927130] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.927130] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.927130] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.927130] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8806842e-05bb-42d4-891f-7827a3b60a33 is going to be updated. [ 743.960575] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.960772] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.962845] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.962991] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.963075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.963286] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.963426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.964518] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53bc37f7-2108-4d37-a1d0-082b0539da45 with status ACTIVE [ 743.964695] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.964803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.964868] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.965046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.965129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.965290] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.965385] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.965447] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.965629] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.965720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.966611] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.966765] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.966838] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.966990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.967313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.967410] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53bc37f7-2108-4d37-a1d0-082b0539da45 is going to be updated. [ 743.977546] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: IN_PROGRESS for 2s [ 743.993173] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.993485] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.993563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.993777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.993914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.994140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53bc37f7-2108-4d37-a1d0-082b0539da45" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.992554] env[66519]: INFO networking_nsxv3.common.synchronization [req-076d4029-529e-4c56-a076-2e1ece5e74f1 req-dd734e2c-430b-4677-ac7b-9be48726f383 tempest-ServersWithSpecificFlavorTestJSON-1863263519 tempest-ServersWithSpecificFlavorTestJSON-1863263519-project-member] Enqueued Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_members [ 744.993115] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_members [ 744.993634] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-393aa0d3-c462-4737-b799-041054ed8323 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.993634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.993634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.993889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.993941] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.994194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.994299] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.994469] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.994560] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.994683] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393aa0d3-c462-4737-b799-041054ed8323',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.214204] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: SUCCESS [ 745.214435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.214654] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.214938] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.215170] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.215316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.215407] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.215819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.215819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.215819] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.497204] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.497318] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.497371] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.497547] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.497685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.497940] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.498065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.498124] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.498290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.498367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.498450] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393aa0d3-c462-4737-b799-041054ed8323 is going to be updated. [ 745.504803] env[66519]: INFO networking_nsxv3.common.synchronization [req-8e96e73a-98ef-49ab-946b-70d09727fc55 req-a88ba6bb-cd08-4786-b5b6-07001a5ca3e4 tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 745.504932] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 745.505177] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.505329] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.505414] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.505669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.505830] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.505939] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.506026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.506871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.507018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.507109] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.530106] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.530405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.530497] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.530679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.530865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.541674] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393aa0d3-c462-4737-b799-041054ed8323 in Status: IN_PROGRESS for 2s [ 745.721273] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.907485] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.907485] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.907485] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.907485] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.908042] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.908042] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.908042] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.908556] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.908712] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.908915] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.909034] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.909134] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.909232] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.909337] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.909433] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.909558] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.929254] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.929421] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 745.929542] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.929709] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.930028] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-0c82a18e-d5de-46b1-9dae-d2ecfb9a2736 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.930198] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-0c82a18e-d5de-46b1-9dae-d2ecfb9a2736" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.930307] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-0c82a18e-d5de-46b1-9dae-d2ecfb9a2736" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.930628] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-0c82a18e-d5de-46b1-9dae-d2ecfb9a2736" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.930757] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c82a18e-d5de-46b1-9dae-d2ecfb9a2736',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.989689] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: SUCCESS [ 745.989911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.990318] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.990377] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.990612] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.990753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.990823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.990978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.991074] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.991353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.991353] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.010561] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.010561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.010561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.010561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.010561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.010561] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.011198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.011198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.011198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.011198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.011198] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 already deleted. [ 746.011198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.223996] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.415628] env[66519]: INFO networking_nsxv3.common.synchronization [None req-bb029df9-737a-4394-b18a-5e743c21a14e None None] Enqueued Resource ID: ca3b18f1-f158-45bf-9709-34d7c5abe5b7 with Priority: HIGHEST for action port [ 746.415628] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca3b18f1-f158-45bf-9709-34d7c5abe5b7 with Priority: HIGHEST for action port [ 746.415904] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca3b18f1-f158-45bf-9709-34d7c5abe5b7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.416144] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca3b18f1-f158-45bf-9709-34d7c5abe5b7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.416227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca3b18f1-f158-45bf-9709-34d7c5abe5b7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.416490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca3b18f1-f158-45bf-9709-34d7c5abe5b7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.416571] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca3b18f1-f158-45bf-9709-34d7c5abe5b7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.433509] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.433790] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.433924] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.434189] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.434330] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.434472] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 0c82a18e-d5de-46b1-9dae-d2ecfb9a2736 not found, creating... [ 746.434727] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.434877] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.435519] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.435519] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.435519] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.435712] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.435862] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.435991] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.436130] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.436251] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.436394] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 0c82a18e-d5de-46b1-9dae-d2ecfb9a2736 is going to be created. [ 746.456702] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.456926] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.457012] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.457295] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.457517] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.457733] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-0c82a18e-d5de-46b1-9dae-d2ecfb9a2736" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.495020] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.495202] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.495265] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.495489] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.495918] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.495918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.495918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.496204] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.496204] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.496204] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.496763] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.496763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.496763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.496763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.496763] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.496933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.496933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.497059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.497101] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.497179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.497306] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.729402] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.729402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.729402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.729402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.729402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.729402] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f825e83f-7046-4bbd-969b-a037ace80c92 is going to be updated. [ 746.758277] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.758666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.760665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.760665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.760665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.768561] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: IN_PROGRESS for 2s [ 746.919892] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca3b18f1-f158-45bf-9709-34d7c5abe5b7 [ 746.919892] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.919892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.919892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.919892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.919892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.919892] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca3b18f1-f158-45bf-9709-34d7c5abe5b7 already deleted. [ 746.919892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca3b18f1-f158-45bf-9709-34d7c5abe5b7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.004397] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8806842e-05bb-42d4-891f-7827a3b60a33: rpc.has_security_group_logging(os_id): False [ 747.023086] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.023614] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.023614] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.023614] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.023760] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.024113] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.024218] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.024323] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.024576] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.024707] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.027619] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.027619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.027910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.027910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.027986] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.028183] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.028373] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.028440] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.028659] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.028694] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.028764] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8806842e-05bb-42d4-891f-7827a3b60a33 is going to be updated. [ 747.093538] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.093792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.093865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.094081] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.094227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.111118] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: IN_PROGRESS for 2s [ 747.202630] env[66519]: INFO networking_nsxv3.common.synchronization [req-8e96e73a-98ef-49ab-946b-70d09727fc55 req-729b386a-ad14-4e6c-ab63-4855248a87fe service nova] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_rules [ 747.202812] env[66519]: INFO networking_nsxv3.common.synchronization [req-8e96e73a-98ef-49ab-946b-70d09727fc55 req-729b386a-ad14-4e6c-ab63-4855248a87fe service nova] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 747.202943] env[66519]: INFO networking_nsxv3.common.synchronization [req-8e96e73a-98ef-49ab-946b-70d09727fc55 req-729b386a-ad14-4e6c-ab63-4855248a87fe service nova] Enqueued Resource ID: 0c82a18e-d5de-46b1-9dae-d2ecfb9a2736 with Priority: HIGHEST for action port [ 747.203483] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_rules [ 747.203688] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 747.203803] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c82a18e-d5de-46b1-9dae-d2ecfb9a2736 with Priority: HIGHEST for action port [ 747.204374] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.204514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.204565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.204830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.204905] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.205909] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.206232] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.206232] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.206353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.207279] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.207279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.207279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.207483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.207531] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.207609] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.208621] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c82a18e-d5de-46b1-9dae-d2ecfb9a2736 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.209718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c82a18e-d5de-46b1-9dae-d2ecfb9a2736" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.209718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c82a18e-d5de-46b1-9dae-d2ecfb9a2736" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.209718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c82a18e-d5de-46b1-9dae-d2ecfb9a2736" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.209718] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c82a18e-d5de-46b1-9dae-d2ecfb9a2736',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.552353] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393aa0d3-c462-4737-b799-041054ed8323 in Status: SUCCESS [ 747.552491] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393aa0d3-c462-4737-b799-041054ed8323 deletion is rescheduled due to dependency. [ 747.552618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.711126] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.712275] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.712395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.712983] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c82a18e-d5de-46b1-9dae-d2ecfb9a2736 with status ACTIVE [ 747.713254] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.713421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.713502] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.713669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.713768] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.713989] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.714128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.714280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.714528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.714650] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.714909] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.715101] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.715145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.715337] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.715403] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.715450] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c82a18e-d5de-46b1-9dae-d2ecfb9a2736 is going to be updated. [ 747.744127] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.744551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.744551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.745341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.745341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.745341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c82a18e-d5de-46b1-9dae-d2ecfb9a2736" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.213758] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.718644] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.718953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.719117] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.719502] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.719562] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.719865] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be created. [ 748.744749] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.744896] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.744964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.745193] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.745352] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.756373] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: UNINITIALIZED for 2s [ 748.779438] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: SUCCESS [ 748.779438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.779438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.779438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.779438] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.779438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.779438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.779438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.779438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.779438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.779438] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.129704] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: SUCCESS [ 749.129890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.273619] env[66519]: INFO networking_nsxv3.common.synchronization [None req-4c14c6d1-4175-459f-96da-6d569a6cbc69 None None] Enqueued Resource ID: 1a2acd8a-0e5f-423f-aa54-fdce1ba76e5e with Priority: HIGHEST for action port [ 749.273924] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a2acd8a-0e5f-423f-aa54-fdce1ba76e5e with Priority: HIGHEST for action port [ 749.274092] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a2acd8a-0e5f-423f-aa54-fdce1ba76e5e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.274212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a2acd8a-0e5f-423f-aa54-fdce1ba76e5e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.274282] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a2acd8a-0e5f-423f-aa54-fdce1ba76e5e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.274542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a2acd8a-0e5f-423f-aa54-fdce1ba76e5e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.274631] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a2acd8a-0e5f-423f-aa54-fdce1ba76e5e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.280502] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.280715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.280715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.280925] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.281099] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.281220] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.281251] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.281511] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.281511] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.281735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.281735] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.281946] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.281946] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.282132] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.282162] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.282273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.282337] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.282419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.282499] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.282583] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.282670] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.776965] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a2acd8a-0e5f-423f-aa54-fdce1ba76e5e [ 749.777300] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.777501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.777583] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.777866] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.777976] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.778099] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a2acd8a-0e5f-423f-aa54-fdce1ba76e5e already deleted. [ 749.778168] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a2acd8a-0e5f-423f-aa54-fdce1ba76e5e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.787536] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f825e83f-7046-4bbd-969b-a037ace80c92: rpc.has_security_group_logging(os_id): False [ 749.856894] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.858883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.858883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.858883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.858883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.858883] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.858883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.858883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.858883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.858883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.859404] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.859404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.859404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.859509] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.859595] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.859811] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.859918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.859983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.860176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.860288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.860627] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f825e83f-7046-4bbd-969b-a037ace80c92 is going to be updated. [ 749.950591] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.950591] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.952901] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.952901] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.952901] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.973327] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: IN_PROGRESS for 2s [ 750.767264] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: SUCCESS [ 750.767605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.767711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.767946] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.768165] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.768284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.768350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.768509] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.768594] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.768681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.768775] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.271423] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.272071] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.272071] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.272071] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.272487] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.272487] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.272487] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.272743] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.272743] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.272842] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.273019] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.273117] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.273210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.273679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.273679] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.273791] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.273791] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.273937] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.275025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.275155] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.275315] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.333741] env[66519]: INFO networking_nsxv3.common.synchronization [req-d7be96a9-6372-428a-9d3c-0f483c840083 req-2bd7291c-1356-4ba8-965b-ce31379f08e4 tempest-ImagesOneServerTestJSON-1889945922 tempest-ImagesOneServerTestJSON-1889945922-project-member] Enqueued Resource ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 with Priority: HIGHEST for action security_group_members [ 751.334803] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 with Priority: HIGHEST for action security_group_members [ 751.335510] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.335969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.336165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.336447] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.336763] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.336949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.337081] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.337391] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.337741] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.337741] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c764bdd1-e51a-4d68-8351-c0fcec7cc0d1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.778458] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a5c9fd2-e0f8-469b-9019-610142582634: rpc.has_security_group_logging(os_id): False [ 751.801102] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.801102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.801102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.801505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.801546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.802103] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.802103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.802103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.802317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.806115] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.807663] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.807663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.807663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.807663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.807663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.807663] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.807663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.807663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.807663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.807663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.807663] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be created. [ 751.840202] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.843142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.843142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.843142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.843142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.843142] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.843142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.843142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.843142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.843142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.843142] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 is going to be updated. [ 751.875482] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.875708] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.875708] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.878795] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.878795] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.887142] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.887294] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.887511] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.887748] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.887815] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.889640] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 in Status: IN_PROGRESS for 2s [ 751.912191] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: IN_PROGRESS for 2s [ 752.005637] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: SUCCESS [ 752.005987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.776839] env[66519]: INFO networking_nsxv3.common.synchronization [None req-8694be20-ec35-422a-a04c-68976da36add tempest-ImagesOneServerNegativeTestJSON-1631615325 tempest-ImagesOneServerNegativeTestJSON-1631615325-project-member] Enqueued Resource ID: dce3ed82-417d-4d79-a936-0b0f27eaf050 with Priority: HIGHEST for action security_group_rules [ 753.777790] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dce3ed82-417d-4d79-a936-0b0f27eaf050 with Priority: HIGHEST for action security_group_rules [ 753.777982] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dce3ed82-417d-4d79-a936-0b0f27eaf050 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.778190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dce3ed82-417d-4d79-a936-0b0f27eaf050" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.778296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dce3ed82-417d-4d79-a936-0b0f27eaf050" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.778618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dce3ed82-417d-4d79-a936-0b0f27eaf050" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.778745] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dce3ed82-417d-4d79-a936-0b0f27eaf050',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.900306] env[66519]: INFO networking_nsxv3.common.synchronization [None req-63d2faf4-a2ae-4915-bc2a-a734d1a0dee6 tempest-ImagesOneServerNegativeTestJSON-1631615325 tempest-ImagesOneServerNegativeTestJSON-1631615325-project-member] Enqueued Resource ID: dce3ed82-417d-4d79-a936-0b0f27eaf050 with Priority: HIGHEST for action security_group_rules [ 753.901193] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 in Status: SUCCESS [ 753.901324] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c764bdd1-e51a-4d68-8351-c0fcec7cc0d1 deletion is rescheduled due to dependency. [ 753.901467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c764bdd1-e51a-4d68-8351-c0fcec7cc0d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.902024] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dce3ed82-417d-4d79-a936-0b0f27eaf050 with Priority: HIGHEST for action security_group_rules [ 753.902356] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dce3ed82-417d-4d79-a936-0b0f27eaf050 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.902466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dce3ed82-417d-4d79-a936-0b0f27eaf050" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.931338] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: SUCCESS [ 753.931338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.299767] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.301737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.301737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.301737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.301737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.301737] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dce3ed82-417d-4d79-a936-0b0f27eaf050 already deleted. [ 754.301737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dce3ed82-417d-4d79-a936-0b0f27eaf050" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.301737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dce3ed82-417d-4d79-a936-0b0f27eaf050" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.301737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dce3ed82-417d-4d79-a936-0b0f27eaf050" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.301737] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dce3ed82-417d-4d79-a936-0b0f27eaf050',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.721884] env[66519]: INFO networking_nsxv3.common.synchronization [req-f81ad198-d704-4f58-b1de-828a27603372 req-0bc48c81-e4f7-449f-960a-510433741461 tempest-ServerActionsV293TestJSON-1719924090 tempest-ServerActionsV293TestJSON-1719924090-project-member] Enqueued Resource ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a with Priority: HIGHEST for action security_group_members [ 754.722622] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a with Priority: HIGHEST for action security_group_members [ 754.723235] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.723442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.723531] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.723936] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.724017] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.724175] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.724763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.724915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.725585] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.725585] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94ea0731-22a6-40ee-a699-ef5f6ebe0f3a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.822805] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.823315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.823315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.823315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.823315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.823446] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dce3ed82-417d-4d79-a936-0b0f27eaf050 already deleted. [ 754.823500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dce3ed82-417d-4d79-a936-0b0f27eaf050" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.004655] env[66519]: INFO networking_nsxv3.common.synchronization [req-da517bdc-2a6e-4209-9fb5-2c68dcba0ab8 req-8eda8316-d69f-44dc-b7d6-9550162b9b1f tempest-AttachInterfacesUnderV243Test-1907112666 tempest-AttachInterfacesUnderV243Test-1907112666-project-member] Enqueued Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_members [ 755.005434] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_members [ 755.005800] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.007116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.007116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.007490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.007669] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.007791] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.007859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.008140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.008198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.008268] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.231546] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.231546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.231546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.231546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.231546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.231546] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.231546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.231546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.231546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.231546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.231546] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a is going to be updated. [ 755.266324] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.266324] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.266324] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.266928] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.267107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.278196] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a in Status: IN_PROGRESS for 2s [ 755.382991] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-729 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.384441] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-729" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.384441] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-729" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.384441] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-729" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.385254] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.385519] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.385913] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.386486] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.386953] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.387245] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.387429] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 755.387583] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 755.387759] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 755.387943] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.389275] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 755.389508] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 755.412331] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 755.412331] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 755.412331] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 755.412331] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-729" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.412331] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-97c8cce3-00c2-49b4-ba27-3aa965fac418 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.412331] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-97c8cce3-00c2-49b4-ba27-3aa965fac418" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.412331] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-97c8cce3-00c2-49b4-ba27-3aa965fac418" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.412657] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-97c8cce3-00c2-49b4-ba27-3aa965fac418" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.412657] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97c8cce3-00c2-49b4-ba27-3aa965fac418',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.511548] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.511737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.511811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.512058] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.512186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.512400] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.512513] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.512552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.512718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.512854] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.513040] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 already deleted. [ 755.513040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.918021] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.918021] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.918021] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.918021] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.918021] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.918021] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 97c8cce3-00c2-49b4-ba27-3aa965fac418 not found, creating... [ 755.918021] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.918021] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.918021] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.918021] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.918021] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.918717] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.918717] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.918717] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.918717] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.918717] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.918717] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 97c8cce3-00c2-49b4-ba27-3aa965fac418 is going to be created. [ 755.955263] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.955263] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.955263] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.955263] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.955263] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.955263] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-97c8cce3-00c2-49b4-ba27-3aa965fac418" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.724889] env[66519]: INFO networking_nsxv3.common.synchronization [req-da517bdc-2a6e-4209-9fb5-2c68dcba0ab8 req-d8eee9f4-02fa-4ece-b11c-d0fbaf974ba0 service nova] Enqueued Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_rules [ 756.724889] env[66519]: INFO networking_nsxv3.common.synchronization [req-da517bdc-2a6e-4209-9fb5-2c68dcba0ab8 req-d8eee9f4-02fa-4ece-b11c-d0fbaf974ba0 service nova] Enqueued Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_members [ 756.725344] env[66519]: INFO networking_nsxv3.common.synchronization [req-da517bdc-2a6e-4209-9fb5-2c68dcba0ab8 req-d8eee9f4-02fa-4ece-b11c-d0fbaf974ba0 service nova] Enqueued Resource ID: 97c8cce3-00c2-49b4-ba27-3aa965fac418 with Priority: HIGHEST for action port [ 756.726527] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_rules [ 756.726527] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_members [ 756.726527] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97c8cce3-00c2-49b4-ba27-3aa965fac418 with Priority: HIGHEST for action port [ 756.727824] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.727824] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.727824] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.727824] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.727824] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.729828] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.730022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.730227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.730567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.730817] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.731202] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.731202] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.731372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.731491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.731613] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.733510] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-97c8cce3-00c2-49b4-ba27-3aa965fac418 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.733510] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97c8cce3-00c2-49b4-ba27-3aa965fac418" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.733510] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97c8cce3-00c2-49b4-ba27-3aa965fac418" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.733510] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97c8cce3-00c2-49b4-ba27-3aa965fac418" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.733510] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97c8cce3-00c2-49b4-ba27-3aa965fac418',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.238658] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.238658] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.238658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.238658] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97c8cce3-00c2-49b4-ba27-3aa965fac418 with status ACTIVE [ 757.238658] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.238658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.238658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.238658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.238658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.238658] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.238658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.238658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.238658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.238658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.239492] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.239492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.239492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.239837] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.241326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.241477] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97c8cce3-00c2-49b4-ba27-3aa965fac418 is going to be updated. [ 757.267409] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.267573] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.267665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.268081] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.268176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.268353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97c8cce3-00c2-49b4-ba27-3aa965fac418" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.299197] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a in Status: SUCCESS [ 757.299459] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a deletion is rescheduled due to dependency. [ 757.299517] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.745418] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.798287] env[66519]: INFO networking_nsxv3.common.synchronization [req-cce63954-e0af-433b-89e2-8b821cf66e83 req-aa754373-d1fd-4062-abae-475fd7748ea2 tempest-FloatingIPsAssociationTestJSON-1821391314 tempest-FloatingIPsAssociationTestJSON-1821391314-project-member] Enqueued Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGHEST for action security_group_members [ 757.798895] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGHEST for action security_group_members [ 757.802461] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.803110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.803248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.803646] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.803890] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.804021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.804106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.804271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.804365] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.804514] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.247825] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.248100] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.248100] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.248344] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.248483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.248626] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 is going to be created. [ 758.262180] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-943 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.262420] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-943" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.262538] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-943" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.262854] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-943" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.263478] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.263730] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.263882] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.264125] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.264274] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.264570] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.264698] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 758.264803] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 758.264906] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 758.265022] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.265125] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 758.265804] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 758.276845] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.277062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.277106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.277372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.277543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.288584] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 758.288769] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 758.288843] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 758.289301] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-943" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.289482] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-bdfd7b19-209d-4a1b-9457-e5b82c39081b taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.289731] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-bdfd7b19-209d-4a1b-9457-e5b82c39081b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.289871] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-bdfd7b19-209d-4a1b-9457-e5b82c39081b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.290432] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-bdfd7b19-209d-4a1b-9457-e5b82c39081b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.290581] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdfd7b19-209d-4a1b-9457-e5b82c39081b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.292964] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 in Status: UNINITIALIZED for 2s [ 758.308674] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.308897] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.308897] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.309187] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.309282] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.309490] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.309625] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.309686] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.309844] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.309925] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.310014] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34191aa8-8997-42e0-88cc-151380dc439e already deleted. [ 758.310126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.793677] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.793888] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.793971] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.794307] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.794461] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.794624] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port bdfd7b19-209d-4a1b-9457-e5b82c39081b not found, creating... [ 758.794998] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.795087] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.795181] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.795790] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.795790] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.795919] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.796159] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.796229] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.796433] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.796532] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.796733] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: bdfd7b19-209d-4a1b-9457-e5b82c39081b is going to be created. [ 758.827982] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.828275] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.828411] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.828831] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.828963] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.829232] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-bdfd7b19-209d-4a1b-9457-e5b82c39081b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.568355] env[66519]: INFO networking_nsxv3.common.synchronization [req-cce63954-e0af-433b-89e2-8b821cf66e83 req-5df9a7a4-8386-4985-b222-1b4c1e7c1647 service nova] Enqueued Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGHEST for action security_group_rules [ 759.568697] env[66519]: INFO networking_nsxv3.common.synchronization [req-cce63954-e0af-433b-89e2-8b821cf66e83 req-5df9a7a4-8386-4985-b222-1b4c1e7c1647 service nova] Enqueued Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGHEST for action security_group_members [ 759.568697] env[66519]: INFO networking_nsxv3.common.synchronization [req-cce63954-e0af-433b-89e2-8b821cf66e83 req-5df9a7a4-8386-4985-b222-1b4c1e7c1647 service nova] Enqueued Resource ID: bdfd7b19-209d-4a1b-9457-e5b82c39081b with Priority: HIGHEST for action port [ 759.569196] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGHEST for action security_group_rules [ 759.569351] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGHEST for action security_group_members [ 759.569450] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdfd7b19-209d-4a1b-9457-e5b82c39081b with Priority: HIGHEST for action port [ 759.569902] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.569902] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.569902] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.570159] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.570235] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.571557] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.571807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.571893] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.572055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.572209] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.572307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.572380] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.572540] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.572628] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.572724] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.574192] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdfd7b19-209d-4a1b-9457-e5b82c39081b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.574328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdfd7b19-209d-4a1b-9457-e5b82c39081b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.574400] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdfd7b19-209d-4a1b-9457-e5b82c39081b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.575045] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdfd7b19-209d-4a1b-9457-e5b82c39081b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.575155] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdfd7b19-209d-4a1b-9457-e5b82c39081b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.846800] env[66519]: INFO networking_nsxv3.common.synchronization [req-837bc587-0539-4ab0-a5d4-32bdfd940c56 req-f8be5ddc-08f4-4415-b724-b66bebf854be tempest-ServersNegativeTestJSON-375310877 tempest-ServersNegativeTestJSON-375310877-project-member] Enqueued Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_members [ 759.847412] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_members [ 759.847708] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.847821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.847903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.848488] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.848488] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.848488] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.848488] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.848705] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.848705] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.848808] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.073721] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.073721] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.075293] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.076482] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bdfd7b19-209d-4a1b-9457-e5b82c39081b with status ACTIVE [ 760.076482] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.076659] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.076698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.076951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.077061] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.077249] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.077351] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.077422] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.077566] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.077768] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.077821] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.077898] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.077958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.080022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.080160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.080344] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bdfd7b19-209d-4a1b-9457-e5b82c39081b is going to be updated. [ 760.124668] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.125160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.125160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.125160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.125258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.126038] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdfd7b19-209d-4a1b-9457-e5b82c39081b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.305359] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 in Status: SUCCESS [ 760.305359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.305653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.305939] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.306571] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.306571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.306714] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.307183] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.308240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.308240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.308240] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.350931] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.582568] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.810480] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.853849] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.089166] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.089166] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.089166] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.089507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.089541] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.089676] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34191aa8-8997-42e0-88cc-151380dc439e is going to be created. [ 761.114926] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.115122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.115222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.115578] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.115816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.133563] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34191aa8-8997-42e0-88cc-151380dc439e in Status: UNINITIALIZED for 2s [ 761.313746] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54b1272e-4345-4ee1-924d-5e0ad1e18bd8: rpc.has_security_group_logging(os_id): False [ 761.340555] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.340555] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.340555] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.340952] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.341020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.341333] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.341447] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.341513] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.341680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.341757] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.341844] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 is going to be created. [ 761.356779] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.356966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.357028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.357255] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.357348] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.357449] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f825e83f-7046-4bbd-969b-a037ace80c92 is going to be updated. [ 761.386928] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.387061] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.387061] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.387266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.387382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.398405] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: IN_PROGRESS for 2s [ 761.407034] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.407034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.407034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.407264] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.407264] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.420588] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 in Status: IN_PROGRESS for 2s [ 763.146237] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34191aa8-8997-42e0-88cc-151380dc439e in Status: SUCCESS [ 763.146513] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.146632] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.146898] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.147109] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.147246] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.147290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.147440] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.147521] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.147608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.147702] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.410028] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: SUCCESS [ 763.410201] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.435427] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 in Status: SUCCESS [ 763.436455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.654619] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.655091] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.655160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.655355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.655542] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.655641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.655706] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.656293] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.656387] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.656481] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.657186] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.657372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.657430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.657563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.657716] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.657813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.657877] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.658029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.658114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.658196] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.658284] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.909219] env[66519]: INFO networking_nsxv3.common.synchronization [req-1f3f3e17-7fc9-497b-a16c-827cdbdb713a req-efe878e9-891c-430f-8da9-66b755ba592b tempest-ServerGroupTestJSON-211898929 tempest-ServerGroupTestJSON-211898929-project-member] Enqueued Resource ID: e42f9b46-5b93-4f52-8003-e84e184c2478 with Priority: HIGHEST for action security_group_members [ 763.909799] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42f9b46-5b93-4f52-8003-e84e184c2478 with Priority: HIGHEST for action security_group_members [ 763.910120] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42f9b46-5b93-4f52-8003-e84e184c2478 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.910244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.910311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.910754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.910754] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.910920] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.910920] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.911715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.911968] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.912170] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42f9b46-5b93-4f52-8003-e84e184c2478',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.165968] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34191aa8-8997-42e0-88cc-151380dc439e: rpc.has_security_group_logging(os_id): False [ 764.188292] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.188292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.188292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.188292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.188292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.188292] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.188292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.188292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.188292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.188292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.188292] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.188292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.188292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.193769] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.193769] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.193769] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.193769] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.193935] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.194974] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.194974] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.194974] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34191aa8-8997-42e0-88cc-151380dc439e is going to be created. [ 764.298047] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.298047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.298047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.298289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.298383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.312242] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34191aa8-8997-42e0-88cc-151380dc439e in Status: IN_PROGRESS for 2s [ 764.382467] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-448 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.382690] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-448" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.382832] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-448" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.383278] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-448" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.383561] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.383865] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.384010] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.384264] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.384404] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.384611] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 764.384735] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 764.384831] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 764.384935] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 764.385060] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 764.385164] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 764.385303] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 764.414654] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 764.414841] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 764.414955] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 764.415136] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-448" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.415456] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-ed1e0469-d3ba-4634-82d7-0166b70288da taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.415620] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-ed1e0469-d3ba-4634-82d7-0166b70288da" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.415767] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-ed1e0469-d3ba-4634-82d7-0166b70288da" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.416129] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-ed1e0469-d3ba-4634-82d7-0166b70288da" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.416282] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed1e0469-d3ba-4634-82d7-0166b70288da',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.417378] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.417496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.417573] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.417732] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.417820] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.417998] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.418128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.418184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.418316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.418390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.418470] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42f9b46-5b93-4f52-8003-e84e184c2478 already deleted. [ 764.418551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.519456] env[66519]: INFO networking_nsxv3.common.synchronization [None req-dfe15f0b-393c-4c10-8efc-9cdbff9aaa3e None None] Enqueued Resource ID: 88bcf242-8384-4c64-9c28-83e99fe139b9 with Priority: HIGHEST for action port [ 764.519863] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88bcf242-8384-4c64-9c28-83e99fe139b9 with Priority: HIGHEST for action port [ 764.520114] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-88bcf242-8384-4c64-9c28-83e99fe139b9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.520280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88bcf242-8384-4c64-9c28-83e99fe139b9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.520338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88bcf242-8384-4c64-9c28-83e99fe139b9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.520627] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88bcf242-8384-4c64-9c28-83e99fe139b9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.520718] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88bcf242-8384-4c64-9c28-83e99fe139b9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.921825] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.921825] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.921825] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.921825] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.921825] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.921825] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port ed1e0469-d3ba-4634-82d7-0166b70288da not found, creating... [ 764.922262] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.922381] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.922470] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.922715] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.922848] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.923135] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.923375] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.923634] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.923710] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.923881] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.924741] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: ed1e0469-d3ba-4634-82d7-0166b70288da is going to be created. [ 764.946360] env[66519]: INFO networking_nsxv3.common.synchronization [req-79fdd996-f7ac-487c-9dde-427748845a2b req-639080ca-cf49-4733-8729-ffe1247022fc tempest-ImagesTestJSON-1420515381 tempest-ImagesTestJSON-1420515381-project-member] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 764.946930] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 764.948172] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.948172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.948172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.948172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.948172] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.948172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.948172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.948567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.948669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.948773] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.951754] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.951754] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.951883] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.952057] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.952860] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.952860] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-ed1e0469-d3ba-4634-82d7-0166b70288da" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.023752] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88bcf242-8384-4c64-9c28-83e99fe139b9 [ 765.024057] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.024057] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.024459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.024459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.024526] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.024658] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88bcf242-8384-4c64-9c28-83e99fe139b9 already deleted. [ 765.024730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88bcf242-8384-4c64-9c28-83e99fe139b9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.451561] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.451871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.451871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.451994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.452098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.452291] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.452385] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.452444] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.452595] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.452666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.452749] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be updated. [ 765.491110] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.491282] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.491347] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.491963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.492187] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.502878] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: IN_PROGRESS for 2s [ 765.825802] env[66519]: INFO networking_nsxv3.common.synchronization [req-1f3f3e17-7fc9-497b-a16c-827cdbdb713a req-079d0e37-fddb-4f3a-944b-984e2de28f89 service nova] Enqueued Resource ID: e42f9b46-5b93-4f52-8003-e84e184c2478 with Priority: HIGHEST for action security_group_rules [ 765.825802] env[66519]: INFO networking_nsxv3.common.synchronization [req-1f3f3e17-7fc9-497b-a16c-827cdbdb713a req-079d0e37-fddb-4f3a-944b-984e2de28f89 service nova] Enqueued Resource ID: e42f9b46-5b93-4f52-8003-e84e184c2478 with Priority: HIGHEST for action security_group_members [ 765.825802] env[66519]: INFO networking_nsxv3.common.synchronization [req-1f3f3e17-7fc9-497b-a16c-827cdbdb713a req-079d0e37-fddb-4f3a-944b-984e2de28f89 service nova] Enqueued Resource ID: ed1e0469-d3ba-4634-82d7-0166b70288da with Priority: HIGHEST for action port [ 765.827496] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42f9b46-5b93-4f52-8003-e84e184c2478 with Priority: HIGHEST for action security_group_rules [ 765.827890] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42f9b46-5b93-4f52-8003-e84e184c2478 with Priority: HIGHEST for action security_group_members [ 765.828213] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed1e0469-d3ba-4634-82d7-0166b70288da with Priority: HIGHEST for action port [ 765.831129] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e42f9b46-5b93-4f52-8003-e84e184c2478 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.831129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.831129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.831129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.831129] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e42f9b46-5b93-4f52-8003-e84e184c2478',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.831129] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42f9b46-5b93-4f52-8003-e84e184c2478 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.831129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.831129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.831129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.831883] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.832146] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.832420] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.833026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.833026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.833026] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42f9b46-5b93-4f52-8003-e84e184c2478',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.834194] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed1e0469-d3ba-4634-82d7-0166b70288da taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.834402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed1e0469-d3ba-4634-82d7-0166b70288da" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.834607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed1e0469-d3ba-4634-82d7-0166b70288da" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.834862] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed1e0469-d3ba-4634-82d7-0166b70288da" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.835149] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed1e0469-d3ba-4634-82d7-0166b70288da',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.844528] env[66519]: INFO networking_nsxv3.common.synchronization [req-ab470c11-e419-4728-894b-17c60e953f4a req-0bd6c493-a327-4fac-9ba0-a08449a73822 tempest-ServerRescueNegativeTestJSON-912870119 tempest-ServerRescueNegativeTestJSON-912870119-project-member] Enqueued Resource ID: 00c72ce6-74fa-4138-bcac-05408508b67c with Priority: HIGHEST for action security_group_members [ 765.844528] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00c72ce6-74fa-4138-bcac-05408508b67c with Priority: HIGHEST for action security_group_members [ 765.844785] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00c72ce6-74fa-4138-bcac-05408508b67c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.844785] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.844916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.845155] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.845340] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.845542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.845542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.845677] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.845765] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.845879] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00c72ce6-74fa-4138-bcac-05408508b67c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.263460] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-401 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.263460] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-401" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.263460] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-401" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.264959] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-401" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.265247] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.265413] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.265525] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.265804] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.265933] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.266151] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.266255] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 766.266354] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 766.266455] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 766.266555] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.266650] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 766.266772] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 766.302245] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 766.302245] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 766.302245] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 766.302245] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-401" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.302245] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-be9d429d-145e-4624-b514-f77850d1ca0b taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.302245] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-be9d429d-145e-4624-b514-f77850d1ca0b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.302245] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-be9d429d-145e-4624-b514-f77850d1ca0b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.302245] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-be9d429d-145e-4624-b514-f77850d1ca0b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.302245] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be9d429d-145e-4624-b514-f77850d1ca0b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.329075] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34191aa8-8997-42e0-88cc-151380dc439e in Status: SUCCESS [ 766.329075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.337219] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42f9b46-5b93-4f52-8003-e84e184c2478',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.338697] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42f9b46-5b93-4f52-8003-e84e184c2478 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.338697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.342460] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ed1e0469-d3ba-4634-82d7-0166b70288da with status ACTIVE [ 766.343683] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.343683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.343683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.343683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.343683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.344023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.344023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.344109] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.344519] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.344519] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.344519] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.344734] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.344734] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.344807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.344852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.344937] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ed1e0469-d3ba-4634-82d7-0166b70288da is going to be updated. [ 766.348306] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.348619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.348697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.348898] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.348987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.349214] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.349331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.349383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.349517] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.349582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.350251] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00c72ce6-74fa-4138-bcac-05408508b67c already deleted. [ 766.350251] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.391494] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.393427] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.393427] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.393427] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.393427] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.393427] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed1e0469-d3ba-4634-82d7-0166b70288da" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.806351] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.806649] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.806691] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.807549] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.807549] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.807549] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port be9d429d-145e-4624-b514-f77850d1ca0b not found, creating... [ 766.807796] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.808079] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.808252] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.809698] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.809698] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.809698] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.809698] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.809698] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.809698] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.809996] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.809996] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: be9d429d-145e-4624-b514-f77850d1ca0b is going to be created. [ 766.835300] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.836099] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.836099] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.836099] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.837572] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.837673] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-be9d429d-145e-4624-b514-f77850d1ca0b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.839623] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42f9b46-5b93-4f52-8003-e84e184c2478',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.856019] env[66519]: INFO networking_nsxv3.common.synchronization [None req-4a61a072-4c0d-42fc-9a86-0ddfc9dabf4b None None] Enqueued Resource ID: ce34e48a-0a9e-4f68-9752-c914b5acb1fb with Priority: HIGHEST for action port [ 766.856573] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce34e48a-0a9e-4f68-9752-c914b5acb1fb with Priority: HIGHEST for action port [ 766.857086] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce34e48a-0a9e-4f68-9752-c914b5acb1fb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.857086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce34e48a-0a9e-4f68-9752-c914b5acb1fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.857205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce34e48a-0a9e-4f68-9752-c914b5acb1fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.859941] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce34e48a-0a9e-4f68-9752-c914b5acb1fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.859941] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce34e48a-0a9e-4f68-9752-c914b5acb1fb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.297698] env[66519]: INFO networking_nsxv3.common.synchronization [req-92870573-ae61-42f6-ae34-858543ec1a75 req-9f6eb027-dedf-4328-a325-92070df4e049 tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 767.298338] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 767.298647] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.298772] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.298840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.299205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.299379] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.299501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.299559] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.299736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.299819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.299916] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.343569] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.343569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.343569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.343983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.344129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.344256] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42f9b46-5b93-4f52-8003-e84e184c2478 is going to be created. [ 767.360232] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce34e48a-0a9e-4f68-9752-c914b5acb1fb [ 767.360232] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.360502] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.360502] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.360606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.360659] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.360706] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce34e48a-0a9e-4f68-9752-c914b5acb1fb already deleted. [ 767.360850] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce34e48a-0a9e-4f68-9752-c914b5acb1fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.370935] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.371209] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.371209] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.371371] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.371511] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.382603] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42f9b46-5b93-4f52-8003-e84e184c2478 in Status: UNINITIALIZED for 2s [ 767.513641] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: SUCCESS [ 767.513830] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 deletion is rescheduled due to dependency. [ 767.513877] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.576765] env[66519]: INFO networking_nsxv3.common.synchronization [req-ab470c11-e419-4728-894b-17c60e953f4a req-fb8db31f-bf48-402c-ac25-b0331bae94d5 service nova] Enqueued Resource ID: 00c72ce6-74fa-4138-bcac-05408508b67c with Priority: HIGHEST for action security_group_rules [ 767.576948] env[66519]: INFO networking_nsxv3.common.synchronization [req-ab470c11-e419-4728-894b-17c60e953f4a req-fb8db31f-bf48-402c-ac25-b0331bae94d5 service nova] Enqueued Resource ID: 00c72ce6-74fa-4138-bcac-05408508b67c with Priority: HIGHEST for action security_group_members [ 767.577132] env[66519]: INFO networking_nsxv3.common.synchronization [req-ab470c11-e419-4728-894b-17c60e953f4a req-fb8db31f-bf48-402c-ac25-b0331bae94d5 service nova] Enqueued Resource ID: be9d429d-145e-4624-b514-f77850d1ca0b with Priority: HIGHEST for action port [ 767.577732] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00c72ce6-74fa-4138-bcac-05408508b67c with Priority: HIGHEST for action security_group_rules [ 767.577922] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00c72ce6-74fa-4138-bcac-05408508b67c with Priority: HIGHEST for action security_group_members [ 767.578076] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be9d429d-145e-4624-b514-f77850d1ca0b with Priority: HIGHEST for action port [ 767.578588] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00c72ce6-74fa-4138-bcac-05408508b67c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.578588] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.578792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.578862] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.578926] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00c72ce6-74fa-4138-bcac-05408508b67c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.580073] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00c72ce6-74fa-4138-bcac-05408508b67c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.580189] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.580245] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.580553] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.580946] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.581020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.581121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.581307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.581307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.581406] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00c72ce6-74fa-4138-bcac-05408508b67c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.582340] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-be9d429d-145e-4624-b514-f77850d1ca0b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.582638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be9d429d-145e-4624-b514-f77850d1ca0b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.582696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be9d429d-145e-4624-b514-f77850d1ca0b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.582812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be9d429d-145e-4624-b514-f77850d1ca0b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.582915] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be9d429d-145e-4624-b514-f77850d1ca0b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.715887] env[66519]: INFO networking_nsxv3.common.synchronization [req-cf35a0ce-2253-4a37-aa5b-d5fc58e7b288 req-968483c8-389a-4c9b-a05d-eb479008abf1 tempest-ServerMetadataTestJSON-81765634 tempest-ServerMetadataTestJSON-81765634-project-member] Enqueued Resource ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 with Priority: HIGHEST for action security_group_members [ 767.716233] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 with Priority: HIGHEST for action security_group_members [ 767.716740] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.717983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.717983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.717983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.717983] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.717983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.717983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.717983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.717983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.717983] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccf6d1d5-d7b2-4eab-a976-db0d74e65462',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.801530] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.801703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.801767] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.801964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.802094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.802293] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.802395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.802447] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.802601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.802717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.802838] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be updated. [ 767.837204] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.837529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.837529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.837921] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.837921] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.847662] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: IN_PROGRESS for 2s [ 768.084397] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00c72ce6-74fa-4138-bcac-05408508b67c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.085831] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00c72ce6-74fa-4138-bcac-05408508b67c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.085939] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.086142] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be9d429d-145e-4624-b514-f77850d1ca0b with status ACTIVE [ 768.086315] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.086912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.086912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.086912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.086912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.087104] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.087104] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.087104] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.087257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.087341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.087553] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.088386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.088386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.088386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.088386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.088386] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be9d429d-145e-4624-b514-f77850d1ca0b is going to be updated. [ 768.112540] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.112742] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.112742] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.112956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.113105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.113262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be9d429d-145e-4624-b514-f77850d1ca0b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.221194] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.221425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.221496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.221718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.221813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.222043] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.222158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.222224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.222404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.222485] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.222576] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 is going to be updated. [ 768.285454] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.285682] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.285863] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.286258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.286437] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.303568] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 in Status: IN_PROGRESS for 2s [ 768.591205] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00c72ce6-74fa-4138-bcac-05408508b67c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.097228] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.100815] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.100815] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.100815] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.100815] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.100815] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00c72ce6-74fa-4138-bcac-05408508b67c is going to be created. [ 769.165814] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.165814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.165814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.165814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.165814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.178011] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00c72ce6-74fa-4138-bcac-05408508b67c in Status: UNINITIALIZED for 2s [ 769.394824] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42f9b46-5b93-4f52-8003-e84e184c2478 in Status: SUCCESS [ 769.395110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.395284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.395531] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.395756] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.396055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.396143] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.396370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.396465] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.396564] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.396886] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e42f9b46-5b93-4f52-8003-e84e184c2478',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.859728] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: SUCCESS [ 769.859937] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 deletion is rescheduled due to dependency. [ 769.861590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.899490] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42f9b46-5b93-4f52-8003-e84e184c2478 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.899714] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.899835] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.900116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.900429] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.900616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.900704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.900881] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.901255] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.901406] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.901934] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42f9b46-5b93-4f52-8003-e84e184c2478 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.902184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.904141] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.904384] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.904582] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.904697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.904783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.904998] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.905175] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.905284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.905393] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e42f9b46-5b93-4f52-8003-e84e184c2478',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.313888] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 in Status: SUCCESS [ 770.314145] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 deletion is rescheduled due to dependency. [ 770.314198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.407502] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e42f9b46-5b93-4f52-8003-e84e184c2478: rpc.has_security_group_logging(os_id): False [ 770.431430] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.431430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.431430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.431430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.431430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.431430] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.431430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.431430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.431430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.431430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.431430] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.431430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.431430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.431430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.431430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.432086] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.432086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.432086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.432249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.432380] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.432940] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e42f9b46-5b93-4f52-8003-e84e184c2478 is going to be created. [ 770.507379] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.507379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.507379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.507379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.507379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.531431] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e42f9b46-5b93-4f52-8003-e84e184c2478 in Status: IN_PROGRESS for 2s [ 770.830489] env[66519]: INFO networking_nsxv3.common.synchronization [req-a0e08c96-8687-4352-9889-4f304672e267 req-87f6afb4-3290-4002-9e54-430e692790b5 tempest-MigrationsAdminTest-1659008040 tempest-MigrationsAdminTest-1659008040-project-member] Enqueued Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGHEST for action security_group_members [ 770.831349] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGHEST for action security_group_members [ 770.831856] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.832063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.832180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.832654] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.832908] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.833128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.833194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.833435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.833570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.833710] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.989157] env[66519]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 770.989355] env[66519]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] NSXv3 Agent Agent loop - iteration:1 started [ 771.190499] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00c72ce6-74fa-4138-bcac-05408508b67c in Status: SUCCESS [ 771.191264] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.192034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.192034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.192034] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.192034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.192283] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.192283] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.192342] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.192485] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.192582] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00c72ce6-74fa-4138-bcac-05408508b67c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.337895] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.339516] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-707 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.339685] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.339814] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.341077] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.341363] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.341526] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.341639] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.341865] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.342016] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.342231] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.342336] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.342439] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.342621] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.342770] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.342827] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.342953] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.365985] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.365985] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 771.366173] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.366227] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-707" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.366530] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-1d06d098-31c6-47f5-a9c9-77719e1721c6 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.366693] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-1d06d098-31c6-47f5-a9c9-77719e1721c6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.366804] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-1d06d098-31c6-47f5-a9c9-77719e1721c6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.367151] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-1d06d098-31c6-47f5-a9c9-77719e1721c6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.367285] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d06d098-31c6-47f5-a9c9-77719e1721c6',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.694989] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00c72ce6-74fa-4138-bcac-05408508b67c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.822099] env[66519]: INFO networking_nsxv3.common.synchronization [req-2e9791a6-f1ba-4490-9ba9-051e6ee177c2 req-eb673e1e-2334-4508-a8bf-42d539c96844 tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 with Priority: HIGHEST for action security_group_members [ 771.822698] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 with Priority: HIGHEST for action security_group_members [ 771.822995] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.823131] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.823197] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.823764] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.823764] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.823764] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.823764] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.823959] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.823959] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.824034] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c8a24d0e-87af-4465-ae43-ca9c589fc6b0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.846033] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.869472] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.869647] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.869813] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.870142] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.870329] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.870638] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 1d06d098-31c6-47f5-a9c9-77719e1721c6 not found, creating... [ 771.870902] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.871397] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.871397] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.871502] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.871955] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.871955] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.872179] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.872338] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.872630] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.872767] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.872929] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 1d06d098-31c6-47f5-a9c9-77719e1721c6 is going to be created. [ 771.894714] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.894829] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.894868] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.895346] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.895551] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.895922] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-1d06d098-31c6-47f5-a9c9-77719e1721c6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.198402] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00c72ce6-74fa-4138-bcac-05408508b67c: rpc.has_security_group_logging(os_id): False [ 772.219674] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.220016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.220016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.220156] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.220248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.220492] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.220593] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.220657] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.220804] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.220879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.220963] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00c72ce6-74fa-4138-bcac-05408508b67c is going to be created. [ 772.283024] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.283163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.283229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.283490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.283744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.296425] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00c72ce6-74fa-4138-bcac-05408508b67c in Status: IN_PROGRESS for 2s [ 772.327534] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.327689] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.327759] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.327974] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.328084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.328279] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.328379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.328440] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.328592] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.328666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.328751] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 is going to be updated. [ 772.347490] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.347945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.347945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.347945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.348133] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.348133] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cb7c090-e083-487a-aa5d-420200af9bce is going to be updated. [ 772.373096] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.373232] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.373303] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.373536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.373717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.385788] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 in Status: IN_PROGRESS for 2s [ 772.389693] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.389848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.389911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.392123] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.392123] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.412842] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cb7c090-e083-487a-aa5d-420200af9bce in Status: IN_PROGRESS for 2s [ 772.553202] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e42f9b46-5b93-4f52-8003-e84e184c2478 in Status: SUCCESS [ 772.553903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.728916] env[66519]: INFO networking_nsxv3.common.synchronization [req-a0e08c96-8687-4352-9889-4f304672e267 req-ec064a0b-8edc-4ea3-8782-90fa9d15229e service nova] Enqueued Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGHEST for action security_group_rules [ 772.728916] env[66519]: INFO networking_nsxv3.common.synchronization [req-a0e08c96-8687-4352-9889-4f304672e267 req-ec064a0b-8edc-4ea3-8782-90fa9d15229e service nova] Enqueued Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGHEST for action security_group_members [ 772.729129] env[66519]: INFO networking_nsxv3.common.synchronization [req-a0e08c96-8687-4352-9889-4f304672e267 req-ec064a0b-8edc-4ea3-8782-90fa9d15229e service nova] Enqueued Resource ID: 1d06d098-31c6-47f5-a9c9-77719e1721c6 with Priority: HIGHEST for action port [ 772.730064] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGHEST for action security_group_rules [ 772.730064] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGHEST for action security_group_members [ 772.730408] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d06d098-31c6-47f5-a9c9-77719e1721c6 with Priority: HIGHEST for action port [ 772.730726] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.730853] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.730936] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.731141] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.731237] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.732936] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.733089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.733269] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d06d098-31c6-47f5-a9c9-77719e1721c6 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.733393] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d06d098-31c6-47f5-a9c9-77719e1721c6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.733430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d06d098-31c6-47f5-a9c9-77719e1721c6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.733618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d06d098-31c6-47f5-a9c9-77719e1721c6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.733739] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d06d098-31c6-47f5-a9c9-77719e1721c6',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.746370] env[66519]: INFO networking_nsxv3.common.synchronization [req-528d0ce8-87f4-487c-a6ff-7ec51c369149 req-a068e44d-b788-4117-921b-425ed5322adf tempest-ListImageFiltersTestJSON-725451738 tempest-ListImageFiltersTestJSON-725451738-project-member] Enqueued Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGHEST for action security_group_members [ 772.746863] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGHEST for action security_group_members [ 772.747249] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.748028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.748028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.748028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.748028] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.748028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.748028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.748306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.748306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.748306] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.235767] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.235987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.238712] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d06d098-31c6-47f5-a9c9-77719e1721c6 with status ACTIVE [ 773.238712] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.238712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.238712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.238712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.238712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.238712] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.238712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.238712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.238712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.238712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.239133] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.239133] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.239133] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.239242] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.239242] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.239296] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d06d098-31c6-47f5-a9c9-77719e1721c6 is going to be updated. [ 773.251346] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.274520] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.274520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.274520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.274520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.274520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.274520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d06d098-31c6-47f5-a9c9-77719e1721c6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.754457] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.262508] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.262508] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.262508] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.262508] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.262508] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.262508] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce52e424-4971-4af0-bb7e-19455530de2e is going to be updated. [ 774.300068] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.300822] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.300822] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.300822] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.301722] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.316839] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce52e424-4971-4af0-bb7e-19455530de2e in Status: IN_PROGRESS for 2s [ 774.321572] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00c72ce6-74fa-4138-bcac-05408508b67c in Status: SUCCESS [ 774.321572] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.395583] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 in Status: SUCCESS [ 774.395965] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c8a24d0e-87af-4465-ae43-ca9c589fc6b0 deletion is rescheduled due to dependency. [ 774.396425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c8a24d0e-87af-4465-ae43-ca9c589fc6b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.420311] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cb7c090-e083-487a-aa5d-420200af9bce in Status: SUCCESS [ 774.420997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.420997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.421236] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.421536] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.421697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.421858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.422029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.422842] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.423038] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.927926] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.243882] env[66519]: INFO networking_nsxv3.common.synchronization [None req-afbdf42a-5111-4034-ae4d-2028c84dcc88 None None] Enqueued Resource ID: 928b7d8e-731d-466c-93aa-59330e31d3be with Priority: HIGHEST for action port [ 775.244867] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 928b7d8e-731d-466c-93aa-59330e31d3be with Priority: HIGHEST for action port [ 775.245504] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-928b7d8e-731d-466c-93aa-59330e31d3be taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.245504] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-928b7d8e-731d-466c-93aa-59330e31d3be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.245504] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-928b7d8e-731d-466c-93aa-59330e31d3be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.245684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-928b7d8e-731d-466c-93aa-59330e31d3be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.245744] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('928b7d8e-731d-466c-93aa-59330e31d3be',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.433544] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.748219] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 928b7d8e-731d-466c-93aa-59330e31d3be [ 775.748219] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.748219] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.748406] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.748497] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.748536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.750026] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:928b7d8e-731d-466c-93aa-59330e31d3be already deleted. [ 775.750026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-928b7d8e-731d-466c-93aa-59330e31d3be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.860468] env[66519]: INFO networking_nsxv3.common.synchronization [req-6a1d5c33-ec92-45c7-a4e2-82af76c4a238 req-48fc4b19-c60c-491e-a6f4-8ea3d518700e tempest-InstanceActionsTestJSON-1044196125 tempest-InstanceActionsTestJSON-1044196125-project-member] Enqueued Resource ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 with Priority: HIGHEST for action security_group_members [ 775.861030] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 with Priority: HIGHEST for action security_group_members [ 775.861327] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a189ee8-76c8-41eb-9042-b1c1fc45d147 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.861451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.861513] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.861758] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.863229] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.863332] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.863395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.863560] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.863645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.863740] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a189ee8-76c8-41eb-9042-b1c1fc45d147',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.935055] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.935400] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.935400] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.935560] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.935598] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.935725] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cb7c090-e083-487a-aa5d-420200af9bce is going to be updated. [ 775.974747] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.975401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.975401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.975401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.975401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.985219] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cb7c090-e083-487a-aa5d-420200af9bce in Status: IN_PROGRESS for 2s [ 776.330484] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce52e424-4971-4af0-bb7e-19455530de2e in Status: SUCCESS [ 776.330484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.333305] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-424 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.333521] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-424" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.333617] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-424" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.334022] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-424" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.334542] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.334706] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.334909] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.335269] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.336339] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.336339] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 776.336339] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.336339] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.336339] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.336339] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 776.336339] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.336820] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.361770] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.361770] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 776.361770] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.362169] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-424" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.363027] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-9636cdb2-1ec8-455b-a855-e347669ccdc5 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.363027] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-9636cdb2-1ec8-455b-a855-e347669ccdc5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.363027] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-9636cdb2-1ec8-455b-a855-e347669ccdc5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.363027] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-9636cdb2-1ec8-455b-a855-e347669ccdc5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.363027] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9636cdb2-1ec8-455b-a855-e347669ccdc5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.371274] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.371274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.371274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.371274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.371274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.371274] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.371274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.371274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.371274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.371274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.371816] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 already deleted. [ 776.371816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.596972] env[66519]: INFO networking_nsxv3.common.synchronization [req-4cb39ddb-1758-4594-bb13-a76ba082fdc7 req-20b82672-9457-4159-86b9-e6840b474c59 tempest-ServersAdminNegativeTestJSON-1811417065 tempest-ServersAdminNegativeTestJSON-1811417065-project-member] Enqueued Resource ID: 820ceacd-99d3-4034-aaf8-315de338869a with Priority: HIGHEST for action security_group_members [ 776.597810] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820ceacd-99d3-4034-aaf8-315de338869a with Priority: HIGHEST for action security_group_members [ 776.598306] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-820ceacd-99d3-4034-aaf8-315de338869a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.598493] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.598608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.598904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.599164] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.599325] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.599435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.599692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.599841] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.600013] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.826525] env[66519]: INFO networking_nsxv3.common.synchronization [None req-d19cd74f-3911-4645-85db-a44695d2afbd tempest-ServerActionsTestOtherA-1261634680 tempest-ServerActionsTestOtherA-1261634680-project-member] Enqueued Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_rules [ 776.826525] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_rules [ 776.826525] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a766da37-b2e2-4b4b-a76f-5622297330c4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.826525] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.826525] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.826816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.826816] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.864806] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.865139] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.865298] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.865560] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.865701] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.865895] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 9636cdb2-1ec8-455b-a855-e347669ccdc5 not found, creating... [ 776.866248] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.866410] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.866802] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.866802] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.866969] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.867383] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.867618] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.867618] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.867722] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.867832] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.867964] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 9636cdb2-1ec8-455b-a855-e347669ccdc5 is going to be created. [ 776.890447] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.890660] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.890780] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.891064] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.891511] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.891547] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-9636cdb2-1ec8-455b-a855-e347669ccdc5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.013490] env[66519]: INFO networking_nsxv3.common.synchronization [None req-d3f1bc05-66bc-42f3-90e2-be86eedd1cff tempest-ServerActionsTestOtherA-1261634680 tempest-ServerActionsTestOtherA-1261634680-project-member] Enqueued Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_rules [ 777.014016] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_rules [ 777.014154] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a766da37-b2e2-4b4b-a76f-5622297330c4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.014258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.103372] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.103372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.103501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.103659] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.103892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.104102] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.104219] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.104283] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.104447] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.104571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.104663] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 820ceacd-99d3-4034-aaf8-315de338869a is going to be updated. [ 777.144062] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.144062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.144062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.144062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.144062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.153803] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820ceacd-99d3-4034-aaf8-315de338869a in Status: IN_PROGRESS for 2s [ 777.350838] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.350992] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.351131] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.351275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.351363] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.351455] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a766da37-b2e2-4b4b-a76f-5622297330c4 already deleted. [ 777.351539] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.351691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.354467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.354467] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.646543] env[66519]: INFO networking_nsxv3.common.synchronization [None req-4ac1558e-5fd4-45ad-90bd-1701ba9d33cd None None] Enqueued Resource ID: 5e42120d-960b-48e9-a167-35855a3aaaf9 with Priority: HIGHEST for action port [ 777.646543] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e42120d-960b-48e9-a167-35855a3aaaf9 with Priority: HIGHEST for action port [ 777.647381] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e42120d-960b-48e9-a167-35855a3aaaf9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.647381] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e42120d-960b-48e9-a167-35855a3aaaf9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.647381] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e42120d-960b-48e9-a167-35855a3aaaf9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.647381] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e42120d-960b-48e9-a167-35855a3aaaf9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.647381] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e42120d-960b-48e9-a167-35855a3aaaf9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.683230] env[66519]: INFO networking_nsxv3.common.synchronization [req-6a1d5c33-ec92-45c7-a4e2-82af76c4a238 req-974f433e-8cf3-45f0-a775-6c152d71b1b3 service nova] Enqueued Resource ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 with Priority: HIGHEST for action security_group_rules [ 777.683230] env[66519]: INFO networking_nsxv3.common.synchronization [req-6a1d5c33-ec92-45c7-a4e2-82af76c4a238 req-974f433e-8cf3-45f0-a775-6c152d71b1b3 service nova] Enqueued Resource ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 with Priority: HIGHEST for action security_group_members [ 777.683230] env[66519]: INFO networking_nsxv3.common.synchronization [req-6a1d5c33-ec92-45c7-a4e2-82af76c4a238 req-974f433e-8cf3-45f0-a775-6c152d71b1b3 service nova] Enqueued Resource ID: 9636cdb2-1ec8-455b-a855-e347669ccdc5 with Priority: HIGHEST for action port [ 777.683678] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 with Priority: HIGHEST for action security_group_rules [ 777.683840] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 with Priority: HIGHEST for action security_group_members [ 777.683950] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9636cdb2-1ec8-455b-a855-e347669ccdc5 with Priority: HIGHEST for action port [ 777.684588] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a189ee8-76c8-41eb-9042-b1c1fc45d147 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.684739] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.685164] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.688158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.688158] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a189ee8-76c8-41eb-9042-b1c1fc45d147',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.688158] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a189ee8-76c8-41eb-9042-b1c1fc45d147 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.688158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.688158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.688158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.688158] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.688476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.688476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.688476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.688476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.688588] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a189ee8-76c8-41eb-9042-b1c1fc45d147',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.691539] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-9636cdb2-1ec8-455b-a855-e347669ccdc5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.691678] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9636cdb2-1ec8-455b-a855-e347669ccdc5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.691737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9636cdb2-1ec8-455b-a855-e347669ccdc5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.691909] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9636cdb2-1ec8-455b-a855-e347669ccdc5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.692855] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9636cdb2-1ec8-455b-a855-e347669ccdc5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.878113] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.878113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.878113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.878113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.878113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.878113] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a766da37-b2e2-4b4b-a76f-5622297330c4 already deleted. [ 777.878113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.998470] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cb7c090-e083-487a-aa5d-420200af9bce in Status: SUCCESS [ 777.998713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.999290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.999519] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.999754] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.999879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.999934] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.000131] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.000200] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.000289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.000398] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.149142] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e42120d-960b-48e9-a167-35855a3aaaf9 [ 778.149427] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.150065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.150141] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.150923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.150923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.150923] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e42120d-960b-48e9-a167-35855a3aaaf9 already deleted. [ 778.150923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e42120d-960b-48e9-a167-35855a3aaaf9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.200246] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9636cdb2-1ec8-455b-a855-e347669ccdc5 with status ACTIVE [ 778.200536] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.200671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.200733] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.200947] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.201043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.202023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.202023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.202023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.202023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.202023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.202023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.202023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.202023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.202023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.202564] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.202564] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9636cdb2-1ec8-455b-a855-e347669ccdc5 is going to be updated. [ 778.203634] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a189ee8-76c8-41eb-9042-b1c1fc45d147 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.203634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.203856] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a189ee8-76c8-41eb-9042-b1c1fc45d147',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.228545] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.228545] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.228545] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.228545] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.228545] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.228545] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9636cdb2-1ec8-455b-a855-e347669ccdc5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.467802] env[66519]: INFO networking_nsxv3.common.synchronization [req-ae3db056-8675-4679-9cf3-7f6b13df9ac9 req-e187afee-d8d6-4556-a666-e7b5f57fee22 tempest-MultipleCreateTestJSON-1661318798 tempest-MultipleCreateTestJSON-1661318798-project-member] Enqueued Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 778.473620] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 778.473620] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.473620] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.473620] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.473620] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.473620] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.473620] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.473620] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.473620] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.473620] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.473620] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.502999] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.503152] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.503152] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.503341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.503510] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.503613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.503676] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.503828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.503914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.504015] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.504175] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.504266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.504524] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.504524] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.504608] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.504688] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.504744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.504879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.504954] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.505070] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.505164] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.708185] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a189ee8-76c8-41eb-9042-b1c1fc45d147',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.852432] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-617 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.852726] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-617" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.852897] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-617" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.853256] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-617" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.853627] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.853936] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.854192] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.854489] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.854685] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.854939] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 778.855135] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 778.855299] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 778.855460] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 778.855616] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 778.855727] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 778.855904] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 778.880206] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 778.880530] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 778.880833] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 778.881158] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-617" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.881672] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-3d59f64a-a286-47c3-9811-c02885943727 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.882043] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-3d59f64a-a286-47c3-9811-c02885943727" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.882220] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-3d59f64a-a286-47c3-9811-c02885943727" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.882573] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-3d59f64a-a286-47c3-9811-c02885943727" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.882750] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d59f64a-a286-47c3-9811-c02885943727',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.975611] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.975803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.975867] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.976155] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.976254] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.976545] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.976697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.976796] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.977051] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.977190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.977310] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db is going to be updated. [ 779.009817] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6cb7c090-e083-487a-aa5d-420200af9bce: rpc.has_security_group_logging(os_id): False [ 779.050292] env[66519]: INFO networking_nsxv3.common.synchronization [req-a0ecb283-0388-42ba-a09f-0e7212324321 req-00d43e46-f52f-4176-9a2d-874d69b0df86 tempest-ServerGroupTestJSON-211898929 tempest-ServerGroupTestJSON-211898929-project-member] Enqueued Resource ID: e42f9b46-5b93-4f52-8003-e84e184c2478 with Priority: HIGHEST for action security_group_members [ 779.055370] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42f9b46-5b93-4f52-8003-e84e184c2478 with Priority: HIGHEST for action security_group_members [ 779.056311] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42f9b46-5b93-4f52-8003-e84e184c2478 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.056487] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.056487] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.056709] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.056863] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.057052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.057150] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.057269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.057355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.057487] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42f9b46-5b93-4f52-8003-e84e184c2478',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.107073] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.107248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.107353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.107565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.108582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.108582] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.108582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.108582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.108582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.108582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.108582] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.109219] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.109219] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.109219] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.109219] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.109219] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.109374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.109374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.111194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.111194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.111194] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cb7c090-e083-487a-aa5d-420200af9bce is going to be updated. [ 779.147566] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.147750] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.147801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.148024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.148180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.170836] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: IN_PROGRESS for 2s [ 779.184792] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820ceacd-99d3-4034-aaf8-315de338869a in Status: SUCCESS [ 779.184792] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 820ceacd-99d3-4034-aaf8-315de338869a deletion is rescheduled due to dependency. [ 779.184792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.210746] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.210975] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.210975] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.211280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.211380] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.211487] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 is going to be created. [ 779.277272] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.277272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.277272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.277468] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.277701] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.297116] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.297305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.297305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.297506] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.297672] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.299587] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cb7c090-e083-487a-aa5d-420200af9bce in Status: IN_PROGRESS for 2s [ 779.312844] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 in Status: UNINITIALIZED for 2s [ 779.385810] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.386197] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.386347] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.386656] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.386803] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.387013] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 3d59f64a-a286-47c3-9811-c02885943727 not found, creating... [ 779.387336] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.387508] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.387622] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.387872] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.388031] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.388344] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.388512] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.388696] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.388838] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.388996] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.389172] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 3d59f64a-a286-47c3-9811-c02885943727 is going to be created. [ 779.418391] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.418657] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.418779] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.419566] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.419849] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.420152] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-3d59f64a-a286-47c3-9811-c02885943727" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.559970] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.561028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.561028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.561195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.561262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.561591] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.562122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.562122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.562231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.562338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.562459] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42f9b46-5b93-4f52-8003-e84e184c2478 is going to be updated. [ 779.611712] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.611856] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.611856] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.612160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.612412] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.629088] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42f9b46-5b93-4f52-8003-e84e184c2478 in Status: IN_PROGRESS for 2s [ 780.156550] env[66519]: INFO networking_nsxv3.common.synchronization [req-ae3db056-8675-4679-9cf3-7f6b13df9ac9 req-c5a7f5c9-d8c7-4841-ad7d-c49258047eef service nova] Enqueued Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_rules [ 780.156550] env[66519]: INFO networking_nsxv3.common.synchronization [req-ae3db056-8675-4679-9cf3-7f6b13df9ac9 req-c5a7f5c9-d8c7-4841-ad7d-c49258047eef service nova] Enqueued Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 780.156745] env[66519]: INFO networking_nsxv3.common.synchronization [req-ae3db056-8675-4679-9cf3-7f6b13df9ac9 req-c5a7f5c9-d8c7-4841-ad7d-c49258047eef service nova] Enqueued Resource ID: 3d59f64a-a286-47c3-9811-c02885943727 with Priority: HIGHEST for action port [ 780.157531] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_rules [ 780.157748] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 780.157915] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d59f64a-a286-47c3-9811-c02885943727 with Priority: HIGHEST for action port [ 780.159566] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.159790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.159895] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.160248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.160387] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.164134] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.165366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.165366] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d59f64a-a286-47c3-9811-c02885943727 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.165366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d59f64a-a286-47c3-9811-c02885943727" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.165366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d59f64a-a286-47c3-9811-c02885943727" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.165366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d59f64a-a286-47c3-9811-c02885943727" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.165366] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d59f64a-a286-47c3-9811-c02885943727',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.667709] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.667709] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.668101] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d59f64a-a286-47c3-9811-c02885943727 with status ACTIVE [ 780.668101] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.668188] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.668188] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.668507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.668698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.668863] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.672025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.672025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.672025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.672025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.672025] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.672025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.672025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.672025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.672025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.672025] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d59f64a-a286-47c3-9811-c02885943727 is going to be updated. [ 780.699876] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.700136] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.700261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.701905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.701905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.701905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d59f64a-a286-47c3-9811-c02885943727" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.186063] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: SUCCESS [ 781.186063] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db deletion is rescheduled due to dependency. [ 781.186333] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.186639] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.186997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.187264] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.187611] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.187611] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.187759] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.187759] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.187927] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.318659] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cb7c090-e083-487a-aa5d-420200af9bce in Status: SUCCESS [ 781.318659] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.327024] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 in Status: SUCCESS [ 781.327024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.327024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.327024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.327024] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.327024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.327024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.327024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.327024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.327024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.327024] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a189ee8-76c8-41eb-9042-b1c1fc45d147',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.641549] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42f9b46-5b93-4f52-8003-e84e184c2478 in Status: SUCCESS [ 781.641549] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42f9b46-5b93-4f52-8003-e84e184c2478 deletion is rescheduled due to dependency. [ 781.641549] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.690718] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.829616] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a189ee8-76c8-41eb-9042-b1c1fc45d147 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.829771] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.829845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.830122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.830355] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.830480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.830546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.830707] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.830790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.830880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.831669] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a189ee8-76c8-41eb-9042-b1c1fc45d147 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.831669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.831669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.831669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.831669] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.831669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.831669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.831983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.831983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.831983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.831983] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a189ee8-76c8-41eb-9042-b1c1fc45d147',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.195535] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.335674] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a189ee8-76c8-41eb-9042-b1c1fc45d147: rpc.has_security_group_logging(os_id): False [ 782.341497] env[66519]: INFO networking_nsxv3.common.synchronization [req-5685cf94-4133-41d9-b2a2-f004accfb03a req-2d4c6aef-95e4-4dfb-9cc5-1e5de81ab76f tempest-ServersTestBootFromVolume-1611733282 tempest-ServersTestBootFromVolume-1611733282-project-member] Enqueued Resource ID: 245777f4-8235-4258-8d94-22f44ade6a9c with Priority: HIGHEST for action security_group_members [ 782.342147] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 245777f4-8235-4258-8d94-22f44ade6a9c with Priority: HIGHEST for action security_group_members [ 782.342754] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-245777f4-8235-4258-8d94-22f44ade6a9c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.342871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.342871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.343340] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.343517] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.343618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.343727] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.343877] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.344164] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.344164] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('245777f4-8235-4258-8d94-22f44ade6a9c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.356393] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.356646] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.356769] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.357052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.357203] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.357433] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.357647] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.357647] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.358266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.358266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.358266] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.358497] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.358497] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.358663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.358663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.358793] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.358936] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.359055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.359209] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.359319] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.359881] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 is going to be created. [ 782.445111] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.445111] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.445111] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.445111] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.445111] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.464489] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 in Status: IN_PROGRESS for 2s [ 782.704672] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.705043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.705043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.705169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.705222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.705308] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db is going to be updated. [ 782.742568] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.742788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.742969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.743301] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.743527] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.754295] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: IN_PROGRESS for 2s [ 782.847491] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.847808] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.847959] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.848451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.850730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.850730] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.850730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.850730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.850730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.850730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.850730] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 245777f4-8235-4258-8d94-22f44ade6a9c is going to be updated. [ 782.886222] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.886222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.886222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.886222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.886461] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.897060] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 245777f4-8235-4258-8d94-22f44ade6a9c in Status: IN_PROGRESS for 2s [ 783.942077] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.942394] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.942394] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.942556] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.942691] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.446277] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.479812] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 in Status: SUCCESS [ 784.480098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.767632] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: SUCCESS [ 784.767866] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.768059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.768300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.768491] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.768609] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.768682] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.768831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.768915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.769010] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.769123] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.908620] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 245777f4-8235-4258-8d94-22f44ade6a9c in Status: SUCCESS [ 784.909230] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 245777f4-8235-4258-8d94-22f44ade6a9c deletion is rescheduled due to dependency. [ 784.909400] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.948726] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.115194] env[66519]: INFO networking_nsxv3.common.synchronization [req-ae3db056-8675-4679-9cf3-7f6b13df9ac9 req-520b9df6-3880-44f4-928c-5c5a10acfa60 tempest-MultipleCreateTestJSON-1661318798 tempest-MultipleCreateTestJSON-1661318798-project-member] Enqueued Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 785.116173] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 785.116433] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.116569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.116638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.116885] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.117218] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.117310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.117375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.117590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.117650] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.117745] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.272570] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.272570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.452361] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 785.452562] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 785.457705] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-617 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.457910] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-617" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.458041] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-617" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.458338] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-617" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.458615] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.458785] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.458936] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.459125] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.459261] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.459472] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.459606] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.459669] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.459769] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.459893] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.460067] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.460233] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.490050] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.490259] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 785.490417] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.490636] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-617" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.491161] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-44b9d607-f3d1-4dba-a181-66239b275dbd taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.491439] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-44b9d607-f3d1-4dba-a181-66239b275dbd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.491638] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-44b9d607-f3d1-4dba-a181-66239b275dbd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.491999] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-44b9d607-f3d1-4dba-a181-66239b275dbd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.492147] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44b9d607-f3d1-4dba-a181-66239b275dbd',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.620348] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.000294] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.000294] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.000294] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.000294] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.000294] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.000294] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 44b9d607-f3d1-4dba-a181-66239b275dbd not found, creating... [ 786.000784] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.000784] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.000784] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.000955] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.001871] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.002253] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.002425] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.002540] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.002752] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.002879] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.003020] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 44b9d607-f3d1-4dba-a181-66239b275dbd is going to be created. [ 786.027931] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.028177] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.028319] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.029139] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.029463] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.029744] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-44b9d607-f3d1-4dba-a181-66239b275dbd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.123426] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.472244] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.472244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.472244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.472244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.494637] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 786.496120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.498694] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 786.537432] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.538128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.538128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.538440] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.549146] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.549914] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 786.551399] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 786.551399] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 786.599653] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.600009] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.600116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.600525] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.602609] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.602889] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 786.625830] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.626055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.626121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.626372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.626425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.626516] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db is going to be updated. [ 786.660501] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.660684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.660730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.660913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.661102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.672390] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: IN_PROGRESS for 2s [ 786.685578] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.685818] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.685879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.686185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.686499] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.686841] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 786.761012] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.761012] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.761012] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.761012] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.761483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.761483] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:34. [ 786.761483] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'34191aa8-8997-42e0-88cc-151380dc439e', '0a5c9fd2-e0f8-469b-9019-610142582634', '2713653c-36b0-489e-8ec3-6cae0694eead', 'c93d149b-db2a-420d-81f5-177c6bdd9505', '6cb7c090-e083-487a-aa5d-420200af9bce', 'bb0d178a-aa94-4307-b6dd-b216489030fb', 'a5530bb2-b2db-4078-af78-1410edb05dd7', '85cd9d13-e10b-45af-9c04-2923bcfe37db', 'ce52e424-4971-4af0-bb7e-19455530de2e', 'ccf6d1d5-d7b2-4eab-a976-db0d74e65462', '245777f4-8235-4258-8d94-22f44ade6a9c', 'e42f9b46-5b93-4f52-8003-e84e184c2478', 'f40915ba-8560-4243-a90e-1d2bc4bfd564', '54b1272e-4345-4ee1-924d-5e0ad1e18bd8', '91966b7c-171f-4c65-8a17-9eb277064959', 'f825e83f-7046-4bbd-969b-a037ace80c92', '2bb323a7-1c72-4a14-b96f-1b609dfc553a', 'a769e09f-7583-4789-b39d-5853c1dfcd1c', '94ea0731-22a6-40ee-a699-ef5f6ebe0f3a', 'bc7e1373-9ebc-4cc6-b80c-fa60c152026a', '820ceacd-99d3-4034-aaf8-315de338869a', 'facac47b-64fc-4659-9f54-1cb6066b4b88', 'bb3bbf89-6cbf-4b9e-b793-607035a2d9c3', '8806842e-05bb-42d4-891f-7827a3b60a33', 'e0272502-d55a-4dab-9801-a7c27a17a4ef', 'c8a24d0e-87af-4465-ae43-ca9c589fc6b0', '6960f374-b898-4940-b626-d2d9b6819605', '8a189ee8-76c8-41eb-9042-b1c1fc45d147', '00c72ce6-74fa-4138-bcac-05408508b67c', 'c764bdd1-e51a-4d68-8351-c0fcec7cc0d1', '393aa0d3-c462-4737-b799-041054ed8323', 'fc90b596-5915-4a67-a6d8-a20bd8cf9e3c', '376a7ea3-3e4d-4872-be2f-8bc029c25fac', 'a9ed5e58-fb42-4430-8674-e9d732009460'} {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 786.761611] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 786.784762] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.784936] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.784991] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.785243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.785343] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.785602] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 786.785602] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 786.785602] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 786.791900] env[66519]: INFO networking_nsxv3.common.synchronization [req-ae3db056-8675-4679-9cf3-7f6b13df9ac9 req-ba3316ff-1f18-4493-8cf8-96039b6148f6 service nova] Enqueued Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_rules [ 786.792213] env[66519]: INFO networking_nsxv3.common.synchronization [req-ae3db056-8675-4679-9cf3-7f6b13df9ac9 req-ba3316ff-1f18-4493-8cf8-96039b6148f6 service nova] Enqueued Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 786.792506] env[66519]: INFO networking_nsxv3.common.synchronization [req-ae3db056-8675-4679-9cf3-7f6b13df9ac9 req-ba3316ff-1f18-4493-8cf8-96039b6148f6 service nova] Enqueued Resource ID: 44b9d607-f3d1-4dba-a181-66239b275dbd with Priority: HIGHEST for action port [ 786.792946] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_rules [ 786.793100] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 786.793267] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b9d607-f3d1-4dba-a181-66239b275dbd with Priority: HIGHEST for action port [ 786.793464] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.793627] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.793795] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.793997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.794178] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-44b9d607-f3d1-4dba-a181-66239b275dbd taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.794298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44b9d607-f3d1-4dba-a181-66239b275dbd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.794362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44b9d607-f3d1-4dba-a181-66239b275dbd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.794571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44b9d607-f3d1-4dba-a181-66239b275dbd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.794651] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44b9d607-f3d1-4dba-a181-66239b275dbd',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.865503] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.865762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.865762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.866039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.866638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.866843] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 786.866920] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 786.866988] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 786.867157] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 786.867250] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/34 resources of Type:Security Group Rules [ 786.867376] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGH for action security_group_rules [ 786.867435] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGH for action security_group_rules [ 786.867486] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGH for action security_group_rules [ 786.867530] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGH for action security_group_rules [ 786.867574] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGH for action security_group_rules [ 786.867632] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bb0d178a-aa94-4307-b6dd-b216489030fb with Priority: HIGH for action security_group_rules [ 786.867752] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGH for action security_group_rules [ 786.867752] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGH for action security_group_rules [ 786.867963] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGH for action security_group_rules [ 786.867963] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 with Priority: HIGH for action security_group_rules [ 786.867963] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 245777f4-8235-4258-8d94-22f44ade6a9c with Priority: HIGH for action security_group_rules [ 786.867963] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e42f9b46-5b93-4f52-8003-e84e184c2478 with Priority: HIGH for action security_group_rules [ 786.868156] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 with Priority: HIGH for action security_group_rules [ 786.868156] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGH for action security_group_rules [ 786.868156] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 91966b7c-171f-4c65-8a17-9eb277064959 with Priority: HIGH for action security_group_rules [ 786.868304] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGH for action security_group_rules [ 786.868304] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a with Priority: HIGH for action security_group_rules [ 786.868389] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a769e09f-7583-4789-b39d-5853c1dfcd1c with Priority: HIGH for action security_group_rules [ 786.868432] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a with Priority: HIGH for action security_group_rules [ 786.868467] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a with Priority: HIGH for action security_group_rules [ 786.868583] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.296924] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 44b9d607-f3d1-4dba-a181-66239b275dbd with status ACTIVE [ 787.297328] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.297561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.297664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.297911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.298066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.298348] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.298509] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.298626] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.300914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.300914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.300914] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.300914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.300914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.300914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.300914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.300914] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 44b9d607-f3d1-4dba-a181-66239b275dbd is going to be updated. [ 787.330630] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.330895] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.330895] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.331134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.331276] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.331441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44b9d607-f3d1-4dba-a181-66239b275dbd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.488149] env[66519]: INFO networking_nsxv3.common.synchronization [req-9241d180-47cd-4375-a9b5-8a5a56136ca7 req-ef02f9ed-c73c-45fa-beb7-ff69aa766c19 tempest-ListServerFiltersTestJSON-365692851 tempest-ListServerFiltersTestJSON-365692851-project-member] Enqueued Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_members [ 788.488461] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_members [ 788.489423] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGH for action security_group_rules [ 788.491076] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGH for action security_group_rules [ 788.491617] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5530bb2-b2db-4078-af78-1410edb05dd7 with Priority: HIGH for action security_group_rules [ 788.491617] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91966b7c-171f-4c65-8a17-9eb277064959 with Priority: HIGH for action security_group_rules [ 788.491748] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a with Priority: HIGH for action security_group_rules [ 788.491913] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a with Priority: HIGH for action security_group_rules [ 788.492042] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a769e09f-7583-4789-b39d-5853c1dfcd1c with Priority: HIGH for action security_group_rules [ 788.492108] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a with Priority: HIGH for action security_group_rules [ 788.492225] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGH for action security_group_rules [ 788.492337] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGH for action security_group_rules [ 788.492451] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 with Priority: HIGH for action security_group_rules [ 788.492564] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42f9b46-5b93-4f52-8003-e84e184c2478 with Priority: HIGH for action security_group_rules [ 788.492676] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 245777f4-8235-4258-8d94-22f44ade6a9c with Priority: HIGH for action security_group_rules [ 788.492806] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 with Priority: HIGH for action security_group_rules [ 788.492926] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGH for action security_group_rules [ 788.493054] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb0d178a-aa94-4307-b6dd-b216489030fb with Priority: HIGH for action security_group_rules [ 788.493173] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGH for action security_group_rules [ 788.493276] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGH for action security_group_rules [ 788.493382] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGH for action security_group_rules [ 788.493489] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGH for action security_group_rules [ 788.494125] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.494289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.494382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.494608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.494799] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.494932] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.495230] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.495230] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.495395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.495440] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.496881] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.497177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.497293] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.497519] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.497636] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.498845] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.498845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.498845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.499048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.499048] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.501112] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5530bb2-b2db-4078-af78-1410edb05dd7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.501112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.501112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.501112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.501112] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5530bb2-b2db-4078-af78-1410edb05dd7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.502462] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-91966b7c-171f-4c65-8a17-9eb277064959 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.502462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.502462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.502462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.502462] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('91966b7c-171f-4c65-8a17-9eb277064959',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.502963] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc7e1373-9ebc-4cc6-b80c-fa60c152026a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.503124] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.503198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.503358] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.503462] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc7e1373-9ebc-4cc6-b80c-fa60c152026a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.504436] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.504565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.504633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.504758] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.504823] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94ea0731-22a6-40ee-a699-ef5f6ebe0f3a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.505853] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a769e09f-7583-4789-b39d-5853c1dfcd1c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.506048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.506109] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.506290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.506418] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a769e09f-7583-4789-b39d-5853c1dfcd1c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.507745] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bb323a7-1c72-4a14-b96f-1b609dfc553a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.508738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.508738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.508738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.508738] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bb323a7-1c72-4a14-b96f-1b609dfc553a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.509461] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.509706] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.509706] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.510659] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.510659] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.511094] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.511285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.511340] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.511533] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.511581] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.511825] env[66519]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 788.512663] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f40915ba-8560-4243-a90e-1d2bc4bfd564 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.512663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.512803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.512932] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.512997] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f40915ba-8560-4243-a90e-1d2bc4bfd564',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.513971] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e42f9b46-5b93-4f52-8003-e84e184c2478 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.514137] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.514226] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.514515] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.514515] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e42f9b46-5b93-4f52-8003-e84e184c2478',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.515435] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-245777f4-8235-4258-8d94-22f44ade6a9c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.515632] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.515632] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.515804] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.515947] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('245777f4-8235-4258-8d94-22f44ade6a9c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.516776] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccf6d1d5-d7b2-4eab-a976-db0d74e65462 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.516882] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.516948] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.517113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.517250] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccf6d1d5-d7b2-4eab-a976-db0d74e65462',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.520234] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.521717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.521717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.521717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.521717] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.521717] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb0d178a-aa94-4307-b6dd-b216489030fb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.521717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.521717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.522175] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.522175] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb0d178a-aa94-4307-b6dd-b216489030fb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.522753] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.522874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.523120] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.523283] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.523372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.524064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.524064] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.524746] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.524746] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.524884] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.524919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.525151] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.526110] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.526269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.526339] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.526853] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.526853] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.531183] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.531302] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.531431] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.531557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.531741] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.532143] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.532143] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.532350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.532479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.532910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.532910] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.534603] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.691716] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: SUCCESS [ 788.691981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.693079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.693415] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.693740] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.693740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.693740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.694106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.694106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.694106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.694240] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.694240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.694343] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.694421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.694568] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.694653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.694711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.694845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.694952] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.695057] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.695131] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.695429] env[66519]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 788.696093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.696333] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.696555] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.696659] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.696723] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.696867] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.696967] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.697075] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.031407] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.031880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.032098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.032413] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.033307] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.033307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.033307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.033307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.033307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.033307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.033624] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.042290] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.042455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.042502] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.042744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.042925] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.043047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.043114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.043263] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.043348] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.043428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.043571] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.043680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.043766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.044054] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.044196] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.044288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.044383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.044479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.044554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.044659] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.044821] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.045718] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.071791] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.071791] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.071791] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.072140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.072376] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.072376] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.072488] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.072884] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.072884] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.072884] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.073605] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.078479] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.078479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.078479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.078479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.078479] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.078479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.078479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.078479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.078479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.079221] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.079221] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.080633] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.080633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.080633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.080972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.080972] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.080972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.081171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.082192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.082192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.082192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.082192] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.086915] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.087186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.087260] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.087557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.087708] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.087813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.087875] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.088045] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.088113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.088204] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.088317] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.107744] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.107912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.108316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.108669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.140515] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.140694] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.141791] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.141934] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.146485] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.146744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.148658] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.148658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.152960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.152960] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94ea0731-22a6-40ee-a699-ef5f6ebe0f3a is going to be deleted. [ 789.152960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.152960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.158158] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.158395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.159582] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.159730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.160342] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.160537] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.161401] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.161687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.162991] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.163094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.164455] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.164612] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.167330] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.167464] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.168725] env[66519]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 789.169376] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.169471] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.176357] env[66519]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 789.176909] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.176909] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f40915ba-8560-4243-a90e-1d2bc4bfd564 is going to be deleted. [ 789.178163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.178370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.199352] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.199499] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a769e09f-7583-4789-b39d-5853c1dfcd1c is going to be deleted. [ 789.200926] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85cd9d13-e10b-45af-9c04-2923bcfe37db: rpc.has_security_group_logging(os_id): False [ 789.202640] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.207355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.207355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.228135] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.228135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.232791] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.233040] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccf6d1d5-d7b2-4eab-a976-db0d74e65462 is going to be deleted. [ 789.234784] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.235448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.238194] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.238402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.272956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.273348] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be deleted. [ 789.274376] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.274801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.333118] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.333277] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bb323a7-1c72-4a14-b96f-1b609dfc553a is going to be deleted. [ 789.334313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.334537] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.339253] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.339371] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.360780] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.360931] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.396180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.397975] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5530bb2-b2db-4078-af78-1410edb05dd7 is going to be deleted. [ 789.397975] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.397975] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.410243] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.410243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.433688] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.433866] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc7e1373-9ebc-4cc6-b80c-fa60c152026a is going to be deleted. [ 789.434793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.435059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.498312] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.498312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.503298] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.503458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.517964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.518150] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e42f9b46-5b93-4f52-8003-e84e184c2478 is going to be deleted. [ 789.519403] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.519403] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.538262] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.538559] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.538559] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.539827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.539827] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.539827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.539827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.539827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.539827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.539827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.539827] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.540256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.540256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.540256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.540433] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.540539] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.540617] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.540789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.540890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.540989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.541117] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.547847] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34191aa8-8997-42e0-88cc-151380dc439e: rpc.has_security_group_logging(os_id): False [ 789.549933] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.549933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.549933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.550324] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.550324] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.550437] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8806842e-05bb-42d4-891f-7827a3b60a33 is going to be updated. [ 789.578042] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.578223] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.578223] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.578407] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.578587] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.578687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.578748] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.578904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.579196] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.579196] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.579365] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.579441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.579441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.579724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.579724] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.579807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.579843] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.579999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.580103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.580190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.580278] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.581271] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.581583] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.581583] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.581583] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.581733] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.581818] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.582070] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.582070] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.582177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.582300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.582518] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.582518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.582632] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.582679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.582805] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.582891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.582939] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.583137] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.583239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.583325] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.583616] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.584990] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.584990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.584990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.584990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.585372] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.585372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.585372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.585492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.585492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.585569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.585710] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.585801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.585860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.586227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.586427] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.586582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.586685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.587151] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.587320] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.587466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.587648] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.604903] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.607030] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.607030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.622781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.622993] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be deleted. [ 789.624135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.624388] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.625961] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.626097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.627475] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.627543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.677988] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.678156] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 91966b7c-171f-4c65-8a17-9eb277064959 is going to be deleted. [ 789.679421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.679641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.708047] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.740803] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.740803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.740803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.740803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.740803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.755539] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: IN_PROGRESS for 2s [ 789.771319] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.771526] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.776813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.777033] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb0d178a-aa94-4307-b6dd-b216489030fb is going to be deleted. [ 789.782556] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.782986] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.865316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.865316] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 245777f4-8235-4258-8d94-22f44ade6a9c is going to be deleted. [ 789.866394] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.866660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.868738] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.868926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.891681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.891681] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.891681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.891681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.891942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.891942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.892607] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.892607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.892607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.892607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.892607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.892959] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.892959] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.892959] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.893114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.893114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.893177] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db is going to be updated. [ 789.895040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.895040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.895040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.896607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94ea0731-22a6-40ee-a699-ef5f6ebe0f3a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.897249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.897249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.897249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.897249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f40915ba-8560-4243-a90e-1d2bc4bfd564" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.898027] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.898134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.898202] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.898759] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.898848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.898972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-91966b7c-171f-4c65-8a17-9eb277064959" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.899122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.899270] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.899345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.899453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a769e09f-7583-4789-b39d-5853c1dfcd1c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.899564] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.900208] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.900208] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.900208] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccf6d1d5-d7b2-4eab-a976-db0d74e65462" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.900418] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.900571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.900647] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.900759] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bb323a7-1c72-4a14-b96f-1b609dfc553a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.900891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.901065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.901149] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.901283] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.901551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.901551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.951398] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.951515] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.979565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.979830] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.980213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.980288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.980519] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.980727] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.980889] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.981190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.981263] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.981430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.981557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.981750] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.981996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.981996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.982213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.982213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.982302] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34191aa8-8997-42e0-88cc-151380dc439e is going to be updated. [ 789.983593] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.983756] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.984052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.984189] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e42f9b46-5b93-4f52-8003-e84e184c2478" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.984327] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.984483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.984558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.984660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.984810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.984950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.985041] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.985176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5530bb2-b2db-4078-af78-1410edb05dd7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.985283] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.985420] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.985493] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.985592] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc7e1373-9ebc-4cc6-b80c-fa60c152026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.986197] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.986341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.986523] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.986523] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb0d178a-aa94-4307-b6dd-b216489030fb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.043589] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2713653c-36b0-489e-8ec3-6cae0694eead: rpc.has_security_group_logging(os_id): False [ 790.067551] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.067699] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.067757] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.067971] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.068127] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.068200] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-245777f4-8235-4258-8d94-22f44ade6a9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.069092] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.069278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.069278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.069541] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.085148] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f825e83f-7046-4bbd-969b-a037ace80c92: rpc.has_security_group_logging(os_id): False [ 790.089921] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6cb7c090-e083-487a-aa5d-420200af9bce: rpc.has_security_group_logging(os_id): False [ 790.091011] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ce52e424-4971-4af0-bb7e-19455530de2e: rpc.has_security_group_logging(os_id): False [ 790.109813] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54b1272e-4345-4ee1-924d-5e0ad1e18bd8: rpc.has_security_group_logging(os_id): False [ 790.126828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.126828] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.126828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.126828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.126828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.127351] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.127351] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.127505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.127505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.127676] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.127813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.128069] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.128163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.128222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.128426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.128516] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.128589] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2713653c-36b0-489e-8ec3-6cae0694eead is going to be updated. [ 790.139130] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.139317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.139408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.139617] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.139775] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.160211] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.160356] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.160434] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.160653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.162576] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.162734] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.164084] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.164220] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.164917] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.165024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.194727] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.194886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.204538] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: IN_PROGRESS for 2s [ 790.210530] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.210702] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.210824] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.210889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.211126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.211210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.211431] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.211529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.211588] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.211754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.212799] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.213163] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.213292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.213376] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.213559] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.213662] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.213785] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f825e83f-7046-4bbd-969b-a037ace80c92 is going to be updated. [ 790.215147] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.215333] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.216573] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.216718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.217640] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.217640] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.217640] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.217640] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db is going to be updated. [ 790.294399] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.294693] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.294814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.294814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.295231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.295284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.295494] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.295599] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.295662] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.295818] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.295893] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.296328] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.296440] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.296513] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.296679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.296747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.297618] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce52e424-4971-4af0-bb7e-19455530de2e is going to be updated. [ 790.298927] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.299135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.301349] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.301349] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.340043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.340043] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.340043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.340043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.340326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.340326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.340326] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 is going to be updated. [ 790.341454] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.341710] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.343418] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.343541] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.343608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.343780] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.343938] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.377699] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: IN_PROGRESS for 2s [ 790.391467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.391935] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.392167] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.392323] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.392644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.392787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.393122] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.393313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.393432] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.393692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.393820] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.394142] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.394290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.394407] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.394647] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.394774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.394927] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cb7c090-e083-487a-aa5d-420200af9bce is going to be updated. [ 790.396580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.396827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.397197] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.399512] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.400098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.400098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.402529] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.402736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.402847] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.403145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.403374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.426026] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.426026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.426026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.426026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.426335] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.446253] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2713653c-36b0-489e-8ec3-6cae0694eead in Status: IN_PROGRESS for 2s [ 790.458155] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34191aa8-8997-42e0-88cc-151380dc439e in Status: IN_PROGRESS for 2s [ 790.458992] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: IN_PROGRESS for 2s [ 790.468599] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce52e424-4971-4af0-bb7e-19455530de2e in Status: IN_PROGRESS for 2s [ 790.540226] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.540226] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.540226] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.540226] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.540226] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.560723] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 in Status: IN_PROGRESS for 2s [ 790.590683] env[66519]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 790.591329] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.591517] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.591517] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.591762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.592129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.624234] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cb7c090-e083-487a-aa5d-420200af9bce in Status: IN_PROGRESS for 2s [ 791.767250] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: SUCCESS [ 791.767584] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.218491] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: SUCCESS [ 792.218657] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.218828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.219090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.219189] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.392073] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: SUCCESS [ 792.392187] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.461276] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2713653c-36b0-489e-8ec3-6cae0694eead in Status: SUCCESS [ 792.461276] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.482163] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ce52e424-4971-4af0-bb7e-19455530de2e in Status: SUCCESS [ 792.482401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.483193] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34191aa8-8997-42e0-88cc-151380dc439e in Status: SUCCESS [ 792.483370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.484191] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: SUCCESS [ 792.484363] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.577370] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 in Status: SUCCESS [ 792.577588] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.637711] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6cb7c090-e083-487a-aa5d-420200af9bce in Status: SUCCESS [ 792.637932] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.722497] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.722650] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.722701] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.722925] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.723148] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.723231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.723281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.723423] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.723469] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.723554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.723792] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.782305] env[66519]: INFO networking_nsxv3.common.synchronization [req-67a7b3c0-24ad-4190-b5c2-d82c62b39c8d req-503eeffd-bb26-4478-9cc4-857a35f416f2 tempest-ServersWithSpecificFlavorTestJSON-1863263519 tempest-ServersWithSpecificFlavorTestJSON-1863263519-project-member] Enqueued Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_members [ 792.783243] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_members [ 792.783775] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-393aa0d3-c462-4737-b799-041054ed8323 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.784042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.784208] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.784480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.784715] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.784932] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.785093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.785350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.785519] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.785680] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393aa0d3-c462-4737-b799-041054ed8323',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.208347] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-948 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.208544] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-948" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.208660] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-948" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.208925] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-948" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.209203] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.209358] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.209460] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.209666] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.209801] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.210016] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.210617] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.210740] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.210848] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.210963] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.211080] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.211211] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.225586] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.225741] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.225811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.226087] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.226586] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.226586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.226586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.226586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.226825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.226825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.226930] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.227026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.227026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.227203] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.227375] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.227461] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.227524] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.227687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.227750] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.227886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.227886] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.235332] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.235494] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 793.235623] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.235795] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-948" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.236268] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-cf86b364-5644-4073-a164-f562be515f65 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.236813] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-cf86b364-5644-4073-a164-f562be515f65" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.236813] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-cf86b364-5644-4073-a164-f562be515f65" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.236813] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-cf86b364-5644-4073-a164-f562be515f65" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.236997] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf86b364-5644-4073-a164-f562be515f65',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.442934] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.443187] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.443187] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.443407] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.468391] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.468698] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.468839] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.468907] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.469141] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.469225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.469315] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393aa0d3-c462-4737-b799-041054ed8323 is going to be updated. [ 793.497343] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.497539] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.497539] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.497774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.497938] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.511322] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393aa0d3-c462-4737-b799-041054ed8323 in Status: IN_PROGRESS for 2s [ 793.730320] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85cd9d13-e10b-45af-9c04-2923bcfe37db: rpc.has_security_group_logging(os_id): False [ 793.740464] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.740802] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.740966] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.741273] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.741444] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.741677] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port cf86b364-5644-4073-a164-f562be515f65 not found, creating... [ 793.743102] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.743102] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.743102] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.743102] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.743102] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.743295] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.743550] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.743612] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.743884] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.744137] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.744359] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: cf86b364-5644-4073-a164-f562be515f65 is going to be created. [ 793.750319] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.750987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.750987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.750987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.750987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.751238] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.751353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.751575] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.751828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.751951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.752223] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.752603] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.752603] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.752603] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.752705] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.754106] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.754106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.754106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.754106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.754106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.754106] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db is going to be updated. [ 793.770146] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.770146] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.770146] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.770146] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.770954] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.770954] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-cf86b364-5644-4073-a164-f562be515f65" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.817855] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.818191] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.818191] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.818369] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.818679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.836658] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: IN_PROGRESS for 2s [ 794.482947] env[66519]: INFO networking_nsxv3.common.synchronization [req-67a7b3c0-24ad-4190-b5c2-d82c62b39c8d req-b36dd379-1a54-47e0-a65b-33904eedb837 service nova] Enqueued Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_rules [ 794.483185] env[66519]: INFO networking_nsxv3.common.synchronization [req-67a7b3c0-24ad-4190-b5c2-d82c62b39c8d req-b36dd379-1a54-47e0-a65b-33904eedb837 service nova] Enqueued Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_members [ 794.483270] env[66519]: INFO networking_nsxv3.common.synchronization [req-67a7b3c0-24ad-4190-b5c2-d82c62b39c8d req-b36dd379-1a54-47e0-a65b-33904eedb837 service nova] Enqueued Resource ID: cf86b364-5644-4073-a164-f562be515f65 with Priority: HIGHEST for action port [ 794.483768] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_rules [ 794.483902] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_members [ 794.484013] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf86b364-5644-4073-a164-f562be515f65 with Priority: HIGHEST for action port [ 794.484306] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-393aa0d3-c462-4737-b799-041054ed8323 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.484407] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.484489] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.484693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.484774] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('393aa0d3-c462-4737-b799-041054ed8323',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.486694] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-393aa0d3-c462-4737-b799-041054ed8323 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.488325] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.488551] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf86b364-5644-4073-a164-f562be515f65 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.488656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf86b364-5644-4073-a164-f562be515f65" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.488721] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf86b364-5644-4073-a164-f562be515f65" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.488896] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf86b364-5644-4073-a164-f562be515f65" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.488972] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf86b364-5644-4073-a164-f562be515f65',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.549220] env[66519]: INFO networking_nsxv3.common.synchronization [req-da1acf15-a7b8-401c-96d8-d99148bc4826 req-abd98c5c-b3f4-4516-a58b-22e6f7728cf7 tempest-InstanceActionsTestJSON-1044196125 tempest-InstanceActionsTestJSON-1044196125-project-member] Enqueued Resource ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 with Priority: HIGHEST for action security_group_members [ 794.550497] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 with Priority: HIGHEST for action security_group_members [ 794.550497] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a189ee8-76c8-41eb-9042-b1c1fc45d147 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.550497] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.550497] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.550497] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.550854] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.550854] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.550854] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.550975] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.551463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.551463] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a189ee8-76c8-41eb-9042-b1c1fc45d147',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.992894] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-393aa0d3-c462-4737-b799-041054ed8323 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.993266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.994576] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf86b364-5644-4073-a164-f562be515f65 with status ACTIVE [ 794.994820] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.995044] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.995044] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.995311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.995311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.995497] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.995601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.995643] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.995800] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.995874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.996178] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.996294] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.996345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.996487] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.996562] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.996647] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf86b364-5644-4073-a164-f562be515f65 is going to be updated. [ 795.043975] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.044328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.044328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.044432] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.044550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.044731] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf86b364-5644-4073-a164-f562be515f65" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.054249] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.055520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.055520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.055520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.077982] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.078321] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.078433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.078500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.078702] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.078814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.078870] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 is going to be updated. [ 795.107957] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.107957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.107957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.107957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.107957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.116301] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 in Status: IN_PROGRESS for 2s [ 795.521917] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393aa0d3-c462-4737-b799-041054ed8323 in Status: SUCCESS [ 795.522049] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393aa0d3-c462-4737-b799-041054ed8323 deletion is rescheduled due to dependency. [ 795.522149] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.522277] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.522493] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.522672] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.522781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.522840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.522988] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.523083] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.523164] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393aa0d3-c462-4737-b799-041054ed8323',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.853643] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: SUCCESS [ 795.853940] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.854149] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.855634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.856016] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.025844] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('393aa0d3-c462-4737-b799-041054ed8323',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.358662] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.358845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.358880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.359406] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.359637] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.359848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.360020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.360343] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.360478] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.360580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.360673] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.529490] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('393aa0d3-c462-4737-b799-041054ed8323',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.867431] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.867543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.867625] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.867846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.867989] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.868111] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.868173] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.868346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.868435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.868524] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.868672] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.868767] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.868825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.868963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.869111] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.869225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.869286] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.869428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.869501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.869580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.869666] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.035521] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.035803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.035803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.035949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.036143] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.036317] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393aa0d3-c462-4737-b799-041054ed8323 is going to be updated. [ 797.067681] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.067811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.067889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.068095] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.068247] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.079410] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393aa0d3-c462-4737-b799-041054ed8323 in Status: IN_PROGRESS for 2s [ 797.128046] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 in Status: SUCCESS [ 797.128046] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a189ee8-76c8-41eb-9042-b1c1fc45d147 deletion is rescheduled due to dependency. [ 797.128046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a189ee8-76c8-41eb-9042-b1c1fc45d147" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.375774] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 85cd9d13-e10b-45af-9c04-2923bcfe37db: rpc.has_security_group_logging(os_id): False [ 797.396300] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.396300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.396300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.396582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.396582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.396779] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.396882] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.396882] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.397826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.397826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.397826] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.397826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.397826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.397826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.398112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.398268] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.398388] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.398462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.399113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.399113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.399113] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db is going to be updated. [ 797.479422] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.479621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.479735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.480102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.480325] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.503089] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: IN_PROGRESS for 2s [ 798.513058] env[66519]: INFO networking_nsxv3.common.synchronization [req-a452eb4c-e9b6-4abf-9d60-5d176c51601c req-702e925e-83f0-472f-8228-34c093c751f4 tempest-MultipleCreateTestJSON-1661318798 tempest-MultipleCreateTestJSON-1661318798-project-member] Enqueued Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 798.513058] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 798.513058] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.513058] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.513058] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.513816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.514973] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.514973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.514973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.514973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.514973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.514973] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.803457] env[66519]: INFO networking_nsxv3.common.synchronization [req-6c7042b8-9e8e-4f23-b74f-78381df954e0 req-d3c0e537-37aa-4c54-88cb-608c784b1983 tempest-MultipleCreateTestJSON-1661318798 tempest-MultipleCreateTestJSON-1661318798-project-member] Enqueued Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 798.806122] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGHEST for action security_group_members [ 798.806686] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.806813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.017396] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.091886] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393aa0d3-c462-4737-b799-041054ed8323 in Status: SUCCESS [ 799.092153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.092331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.092563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.092778] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.092956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.093073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.093349] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.093439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.093530] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.093625] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('393aa0d3-c462-4737-b799-041054ed8323',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.148934] env[66519]: INFO networking_nsxv3.common.synchronization [None req-8ac1808e-13bb-4759-aee6-40573ea44eee None None] Enqueued Resource ID: c6122d40-fda0-46fd-a9f0-d0edb95eaf74 with Priority: HIGHEST for action port [ 799.149750] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6122d40-fda0-46fd-a9f0-d0edb95eaf74 with Priority: HIGHEST for action port [ 799.150462] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6122d40-fda0-46fd-a9f0-d0edb95eaf74 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.150462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6122d40-fda0-46fd-a9f0-d0edb95eaf74" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.150699] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6122d40-fda0-46fd-a9f0-d0edb95eaf74" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.151120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6122d40-fda0-46fd-a9f0-d0edb95eaf74" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.151120] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6122d40-fda0-46fd-a9f0-d0edb95eaf74',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.518707] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: SUCCESS [ 799.518982] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.520318] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.597646] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('393aa0d3-c462-4737-b799-041054ed8323',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.654575] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6122d40-fda0-46fd-a9f0-d0edb95eaf74 [ 799.654975] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.655335] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.655826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.656341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.656341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.656341] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6122d40-fda0-46fd-a9f0-d0edb95eaf74 already deleted. [ 799.656482] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6122d40-fda0-46fd-a9f0-d0edb95eaf74" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.022572] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.022763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.022834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.023093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.023216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.023324] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db is going to be updated. [ 800.061929] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.062087] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.062163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.062408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.063304] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.072242] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: IN_PROGRESS for 2s [ 800.106149] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 393aa0d3-c462-4737-b799-041054ed8323: rpc.has_security_group_logging(os_id): False [ 800.126896] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.127105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.127219] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.127351] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.127439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.127707] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.127838] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.127905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.128080] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.128162] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.128250] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 393aa0d3-c462-4737-b799-041054ed8323 is going to be updated. [ 800.249770] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.250122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.250250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.250701] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.250701] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.270500] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393aa0d3-c462-4737-b799-041054ed8323 in Status: IN_PROGRESS for 2s [ 801.680439] env[66519]: INFO networking_nsxv3.common.synchronization [None req-255cd81d-2e00-40ea-a477-ae38082382f5 None None] Enqueued Resource ID: 36854a5d-46ff-4247-ae04-2fb9119c3caf with Priority: HIGHEST for action port [ 801.680751] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36854a5d-46ff-4247-ae04-2fb9119c3caf with Priority: HIGHEST for action port [ 801.681315] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-36854a5d-46ff-4247-ae04-2fb9119c3caf taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.681315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36854a5d-46ff-4247-ae04-2fb9119c3caf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.681929] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36854a5d-46ff-4247-ae04-2fb9119c3caf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.681929] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36854a5d-46ff-4247-ae04-2fb9119c3caf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.681929] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36854a5d-46ff-4247-ae04-2fb9119c3caf',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.701460] env[66519]: INFO networking_nsxv3.common.synchronization [None req-52b2eaf2-8d5d-4910-b04c-73043cd56b10 None None] Enqueued Resource ID: 01b69ff1-ab82-4d5c-8ee7-8036f73c7f94 with Priority: HIGHEST for action port [ 801.701460] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01b69ff1-ab82-4d5c-8ee7-8036f73c7f94 with Priority: HIGHEST for action port [ 801.703047] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-01b69ff1-ab82-4d5c-8ee7-8036f73c7f94 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.703047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01b69ff1-ab82-4d5c-8ee7-8036f73c7f94" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.703047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01b69ff1-ab82-4d5c-8ee7-8036f73c7f94" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.703047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01b69ff1-ab82-4d5c-8ee7-8036f73c7f94" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.703047] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01b69ff1-ab82-4d5c-8ee7-8036f73c7f94',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.083195] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: SUCCESS [ 802.083467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.083644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.083936] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.084118] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.084244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.084310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.084943] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.084943] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.084943] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.184182] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36854a5d-46ff-4247-ae04-2fb9119c3caf [ 802.184472] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.184615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.184889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.184889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.185057] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.185111] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36854a5d-46ff-4247-ae04-2fb9119c3caf already deleted. [ 802.185198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36854a5d-46ff-4247-ae04-2fb9119c3caf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.205529] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01b69ff1-ab82-4d5c-8ee7-8036f73c7f94 [ 802.205529] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.205529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.205529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.205529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.205529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.205529] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01b69ff1-ab82-4d5c-8ee7-8036f73c7f94 already deleted. [ 802.205529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01b69ff1-ab82-4d5c-8ee7-8036f73c7f94" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.289461] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 393aa0d3-c462-4737-b799-041054ed8323 in Status: SUCCESS [ 802.289864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.589261] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.589261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.589261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.589261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.589261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.589650] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.589650] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.589650] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.589650] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.589857] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.589857] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db is going to be updated. [ 802.624280] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.624424] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.624491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.624702] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.624841] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.636031] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: IN_PROGRESS for 2s [ 804.181971] env[66519]: INFO networking_nsxv3.common.synchronization [None req-3545e830-dbb8-4ed2-ae09-530f9089e253 None None] Enqueued Resource ID: 14916db0-3bd0-4665-a64e-6b3994543e3f with Priority: HIGHEST for action port [ 804.183507] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14916db0-3bd0-4665-a64e-6b3994543e3f with Priority: HIGHEST for action port [ 804.184513] env[66519]: INFO networking_nsxv3.common.synchronization [req-c24ed89e-44ac-4df4-8423-1c43a7beaa7b req-784a660d-74a6-4a95-891c-4ebf3dd16ee2 tempest-ServersV294TestFqdnHostnames-1610063464 tempest-ServersV294TestFqdnHostnames-1610063464-project-member] Enqueued Resource ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 with Priority: HIGHEST for action security_group_members [ 804.184814] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-14916db0-3bd0-4665-a64e-6b3994543e3f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.184978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14916db0-3bd0-4665-a64e-6b3994543e3f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.184978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14916db0-3bd0-4665-a64e-6b3994543e3f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.185237] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14916db0-3bd0-4665-a64e-6b3994543e3f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.185303] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14916db0-3bd0-4665-a64e-6b3994543e3f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.186944] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 with Priority: HIGHEST for action security_group_members [ 804.188011] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.188011] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.188011] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.188011] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.188011] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.190517] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.190517] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.190517] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.190517] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.190517] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b539ffb-57a2-420e-8eb3-8a80c9021bc6',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.583183] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.584197] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-463" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.584197] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-463" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.584197] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-463" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.584197] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.584435] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.584668] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.585062] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.585328] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.586560] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.586560] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.586560] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.586560] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.586560] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.586852] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.586852] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.614468] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.614640] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 804.614778] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.614983] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-463" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.615337] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-e9002a94-a124-4d49-b392-ea7d81bd33b9 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.615507] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-e9002a94-a124-4d49-b392-ea7d81bd33b9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.615622] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-e9002a94-a124-4d49-b392-ea7d81bd33b9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.616026] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-e9002a94-a124-4d49-b392-ea7d81bd33b9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.616191] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9002a94-a124-4d49-b392-ea7d81bd33b9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.656921] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db in Status: SUCCESS [ 804.656921] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db deletion is rescheduled due to dependency. [ 804.656921] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.687142] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14916db0-3bd0-4665-a64e-6b3994543e3f [ 804.687416] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.687638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.687708] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.687895] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.688013] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.688405] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14916db0-3bd0-4665-a64e-6b3994543e3f already deleted. [ 804.688405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14916db0-3bd0-4665-a64e-6b3994543e3f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.692663] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.692801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.692873] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.693085] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.693254] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.693365] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.693658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.693658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.693772] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.693809] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.693910] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 already deleted. [ 804.693995] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.119298] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.119533] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.119660] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.119933] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.120095] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.120250] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port e9002a94-a124-4d49-b392-ea7d81bd33b9 not found, creating... [ 805.120521] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.120676] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.120789] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.121014] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.121170] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.121453] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.121572] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.121685] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.121882] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.122018] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.122366] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: e9002a94-a124-4d49-b392-ea7d81bd33b9 is going to be created. [ 805.144383] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.144383] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.144383] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.144609] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.144805] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.145040] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-e9002a94-a124-4d49-b392-ea7d81bd33b9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.868573] env[66519]: INFO networking_nsxv3.common.synchronization [req-c24ed89e-44ac-4df4-8423-1c43a7beaa7b req-210b0fc3-c497-4c6c-b1b5-5461111d7101 service nova] Enqueued Resource ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 with Priority: HIGHEST for action security_group_rules [ 805.868817] env[66519]: INFO networking_nsxv3.common.synchronization [req-c24ed89e-44ac-4df4-8423-1c43a7beaa7b req-210b0fc3-c497-4c6c-b1b5-5461111d7101 service nova] Enqueued Resource ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 with Priority: HIGHEST for action security_group_members [ 805.868886] env[66519]: INFO networking_nsxv3.common.synchronization [req-c24ed89e-44ac-4df4-8423-1c43a7beaa7b req-210b0fc3-c497-4c6c-b1b5-5461111d7101 service nova] Enqueued Resource ID: e9002a94-a124-4d49-b392-ea7d81bd33b9 with Priority: HIGHEST for action port [ 805.869461] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 with Priority: HIGHEST for action security_group_rules [ 805.869604] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 with Priority: HIGHEST for action security_group_members [ 805.869704] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9002a94-a124-4d49-b392-ea7d81bd33b9 with Priority: HIGHEST for action port [ 805.869971] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b539ffb-57a2-420e-8eb3-8a80c9021bc6 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.874018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.874018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.874018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.874018] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b539ffb-57a2-420e-8eb3-8a80c9021bc6',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.874018] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.874018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.874018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.874018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.874018] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.874018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.874018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.874018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.874018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.874018] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b539ffb-57a2-420e-8eb3-8a80c9021bc6',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.875039] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9002a94-a124-4d49-b392-ea7d81bd33b9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.875457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9002a94-a124-4d49-b392-ea7d81bd33b9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.875457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9002a94-a124-4d49-b392-ea7d81bd33b9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.875650] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9002a94-a124-4d49-b392-ea7d81bd33b9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.875750] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9002a94-a124-4d49-b392-ea7d81bd33b9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.378852] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.379130] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.379214] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b539ffb-57a2-420e-8eb3-8a80c9021bc6',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.380146] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9002a94-a124-4d49-b392-ea7d81bd33b9 with status ACTIVE [ 806.380331] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.380443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.380514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.380707] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.380793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.380961] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.381070] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.381128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.381272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.381347] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.381523] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.381618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.381671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.381808] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.381910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.381983] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9002a94-a124-4d49-b392-ea7d81bd33b9 is going to be updated. [ 806.405766] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.405989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.406259] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.406451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.406540] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.406773] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9002a94-a124-4d49-b392-ea7d81bd33b9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.501586] env[66519]: INFO networking_nsxv3.common.synchronization [req-e6da50b7-a83f-4cdd-a1f8-79ae05fa5507 req-080e85bd-1e9a-4497-a5c7-2179a0d0cd5b tempest-AttachInterfacesUnderV243Test-1907112666 tempest-AttachInterfacesUnderV243Test-1907112666-project-member] Enqueued Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_members [ 806.502364] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_members [ 806.502716] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.502870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.502938] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.503151] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.503298] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.503408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.503471] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.503681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.503865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.503944] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.535756] env[66519]: INFO networking_nsxv3.common.synchronization [req-e6da50b7-a83f-4cdd-a1f8-79ae05fa5507 req-080e85bd-1e9a-4497-a5c7-2179a0d0cd5b tempest-AttachInterfacesUnderV243Test-1907112666 tempest-AttachInterfacesUnderV243Test-1907112666-project-member] Enqueued Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_rules [ 806.535756] env[66519]: INFO networking_nsxv3.common.synchronization [req-e6da50b7-a83f-4cdd-a1f8-79ae05fa5507 req-080e85bd-1e9a-4497-a5c7-2179a0d0cd5b tempest-AttachInterfacesUnderV243Test-1907112666 tempest-AttachInterfacesUnderV243Test-1907112666-project-member] Enqueued Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_members [ 806.535756] env[66519]: INFO networking_nsxv3.common.synchronization [req-e6da50b7-a83f-4cdd-a1f8-79ae05fa5507 req-080e85bd-1e9a-4497-a5c7-2179a0d0cd5b tempest-AttachInterfacesUnderV243Test-1907112666 tempest-AttachInterfacesUnderV243Test-1907112666-project-member] Enqueued Resource ID: 97c8cce3-00c2-49b4-ba27-3aa965fac418 with Priority: HIGHEST for action port [ 806.536355] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_rules [ 806.537683] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_members [ 806.537683] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97c8cce3-00c2-49b4-ba27-3aa965fac418 with Priority: HIGHEST for action port [ 806.537683] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.537969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.537969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.539837] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.539837] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.541823] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.542020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.542458] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-97c8cce3-00c2-49b4-ba27-3aa965fac418 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.543227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97c8cce3-00c2-49b4-ba27-3aa965fac418" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.543227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97c8cce3-00c2-49b4-ba27-3aa965fac418" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.543227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97c8cce3-00c2-49b4-ba27-3aa965fac418" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.543227] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97c8cce3-00c2-49b4-ba27-3aa965fac418',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.883746] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b539ffb-57a2-420e-8eb3-8a80c9021bc6',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.887659] env[66519]: INFO networking_nsxv3.common.synchronization [req-f9849080-826e-4165-b479-d79622e1e082 req-df21d546-9f0f-46ee-842e-ff7203f73d74 tempest-AttachInterfacesV270Test-64898659 tempest-AttachInterfacesV270Test-64898659-project-member] Enqueued Resource ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 with Priority: HIGHEST for action security_group_members [ 806.888087] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 with Priority: HIGHEST for action security_group_members [ 806.888415] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00387676-9ba9-4227-8ddc-1da0bacf2f93 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.888561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.888699] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.888846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.889032] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.889121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.889182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.889324] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.889404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.889494] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00387676-9ba9-4227-8ddc-1da0bacf2f93',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.006802] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.048492] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97c8cce3-00c2-49b4-ba27-3aa965fac418 with status ACTIVE [ 807.048740] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.048905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.048961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.049180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.049273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.049455] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.049586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.049586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.049735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.049902] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.050078] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.050204] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.050263] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.050361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.050433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.050516] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97c8cce3-00c2-49b4-ba27-3aa965fac418 is going to be updated. [ 807.052621] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.052621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.073345] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.073510] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.073567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.074511] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.074511] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.074511] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97c8cce3-00c2-49b4-ba27-3aa965fac418" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.209898] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-243 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.210216] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-243" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.210409] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-243" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.210875] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-243" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.211348] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.211602] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.211783] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.212127] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.212324] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.212534] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 807.212643] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 807.212745] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 807.212845] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 807.212948] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 807.213110] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 807.213246] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.231652] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.231828] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 807.231959] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.232173] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-243" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.232499] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-4e340d88-d7bc-4e7e-8fa6-3b99ce9323a0 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.232667] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-4e340d88-d7bc-4e7e-8fa6-3b99ce9323a0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.232961] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-4e340d88-d7bc-4e7e-8fa6-3b99ce9323a0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.233289] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-4e340d88-d7bc-4e7e-8fa6-3b99ce9323a0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.233436] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e340d88-d7bc-4e7e-8fa6-3b99ce9323a0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.390913] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.390913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.390913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.390913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.390913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.390913] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 is going to be created. [ 807.392999] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.393136] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.393207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.393477] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.393477] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.393685] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.393793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.393857] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.394105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.394105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.394234] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 already deleted. [ 807.394314] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.415512] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.415653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.415722] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.415932] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.416262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.428467] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 in Status: UNINITIALIZED for 2s [ 807.510284] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.737214] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.737214] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.737214] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.737461] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.737761] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.738034] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 4e340d88-d7bc-4e7e-8fa6-3b99ce9323a0 not found, creating... [ 807.738383] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.738666] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.740076] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.740076] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.740076] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.740076] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.740076] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.740076] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.740076] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.740076] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.740443] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 4e340d88-d7bc-4e7e-8fa6-3b99ce9323a0 is going to be created. [ 807.762380] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.762601] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.762757] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.762926] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.763189] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.763395] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-4e340d88-d7bc-4e7e-8fa6-3b99ce9323a0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.015573] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.015573] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.015573] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.015573] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.015573] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.015573] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 is going to be updated. [ 808.045373] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.045462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.045462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.046099] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.046099] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.057763] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 in Status: IN_PROGRESS for 2s [ 808.468389] env[66519]: INFO networking_nsxv3.common.synchronization [req-f9849080-826e-4165-b479-d79622e1e082 req-b4151e23-50c3-4573-93df-f12d8fa352a3 service nova] Enqueued Resource ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 with Priority: HIGHEST for action security_group_rules [ 808.468638] env[66519]: INFO networking_nsxv3.common.synchronization [req-f9849080-826e-4165-b479-d79622e1e082 req-b4151e23-50c3-4573-93df-f12d8fa352a3 service nova] Enqueued Resource ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 with Priority: HIGHEST for action security_group_members [ 808.468831] env[66519]: INFO networking_nsxv3.common.synchronization [req-f9849080-826e-4165-b479-d79622e1e082 req-b4151e23-50c3-4573-93df-f12d8fa352a3 service nova] Enqueued Resource ID: 4e340d88-d7bc-4e7e-8fa6-3b99ce9323a0 with Priority: HIGHEST for action port [ 808.469458] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 with Priority: HIGHEST for action security_group_rules [ 808.469675] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 with Priority: HIGHEST for action security_group_members [ 808.469776] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e340d88-d7bc-4e7e-8fa6-3b99ce9323a0 with Priority: HIGHEST for action port [ 808.470142] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00387676-9ba9-4227-8ddc-1da0bacf2f93 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.470308] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.470385] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.470645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.470729] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00387676-9ba9-4227-8ddc-1da0bacf2f93',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.471677] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00387676-9ba9-4227-8ddc-1da0bacf2f93 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.471807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.471858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.472088] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.472195] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.472287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.472344] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.472482] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.472565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.472648] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00387676-9ba9-4227-8ddc-1da0bacf2f93',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.474224] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e340d88-d7bc-4e7e-8fa6-3b99ce9323a0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.474224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e340d88-d7bc-4e7e-8fa6-3b99ce9323a0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.474830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e340d88-d7bc-4e7e-8fa6-3b99ce9323a0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.474830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e340d88-d7bc-4e7e-8fa6-3b99ce9323a0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.474946] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e340d88-d7bc-4e7e-8fa6-3b99ce9323a0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.977512] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00387676-9ba9-4227-8ddc-1da0bacf2f93 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.977512] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.977512] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00387676-9ba9-4227-8ddc-1da0bacf2f93',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.977955] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e340d88-d7bc-4e7e-8fa6-3b99ce9323a0 with status ACTIVE [ 808.978079] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.978213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.978273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.978545] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.978545] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.978715] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.978859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.978859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.979035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.979092] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.979257] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.979434] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.979434] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.979536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.979597] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.979678] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e340d88-d7bc-4e7e-8fa6-3b99ce9323a0 is going to be updated. [ 809.001884] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.002087] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.002153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.002357] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.002500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.002664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e340d88-d7bc-4e7e-8fa6-3b99ce9323a0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.444296] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 in Status: SUCCESS [ 809.444730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.444807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.445000] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.445235] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.445401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.445464] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.445582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.445665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.445752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.445847] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b539ffb-57a2-420e-8eb3-8a80c9021bc6',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.482251] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00387676-9ba9-4227-8ddc-1da0bacf2f93',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.629921] env[66519]: INFO networking_nsxv3.common.synchronization [req-789550d5-0a34-4cc0-94f6-457a2c94bb90 req-30b2453f-fde5-4ab0-8627-d2e6de6c5fbb tempest-AttachInterfacesUnderV243Test-1907112666 tempest-AttachInterfacesUnderV243Test-1907112666-project-member] Enqueued Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_members [ 809.630580] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_members [ 809.630707] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.630803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.643267] env[66519]: INFO networking_nsxv3.common.synchronization [req-789550d5-0a34-4cc0-94f6-457a2c94bb90 req-30b2453f-fde5-4ab0-8627-d2e6de6c5fbb tempest-AttachInterfacesUnderV243Test-1907112666 tempest-AttachInterfacesUnderV243Test-1907112666-project-member] Enqueued Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_rules [ 809.643370] env[66519]: INFO networking_nsxv3.common.synchronization [req-789550d5-0a34-4cc0-94f6-457a2c94bb90 req-30b2453f-fde5-4ab0-8627-d2e6de6c5fbb tempest-AttachInterfacesUnderV243Test-1907112666 tempest-AttachInterfacesUnderV243Test-1907112666-project-member] Enqueued Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_members [ 809.643438] env[66519]: INFO networking_nsxv3.common.synchronization [req-789550d5-0a34-4cc0-94f6-457a2c94bb90 req-30b2453f-fde5-4ab0-8627-d2e6de6c5fbb tempest-AttachInterfacesUnderV243Test-1907112666 tempest-AttachInterfacesUnderV243Test-1907112666-project-member] Enqueued Resource ID: 97c8cce3-00c2-49b4-ba27-3aa965fac418 with Priority: HIGHEST for action port [ 809.643932] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_rules [ 809.644125] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_members [ 809.644239] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97c8cce3-00c2-49b4-ba27-3aa965fac418 with Priority: HIGHEST for action port [ 809.644516] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.644871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.645012] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.645128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.645398] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-97c8cce3-00c2-49b4-ba27-3aa965fac418 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.645398] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97c8cce3-00c2-49b4-ba27-3aa965fac418" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.645694] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97c8cce3-00c2-49b4-ba27-3aa965fac418" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.645694] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97c8cce3-00c2-49b4-ba27-3aa965fac418" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.645893] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97c8cce3-00c2-49b4-ba27-3aa965fac418',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.950167] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b539ffb-57a2-420e-8eb3-8a80c9021bc6',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.985272] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.985272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.985272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.985417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.985417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.985615] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 is going to be created. [ 810.012846] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.012846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.012846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.012846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.013377] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.023727] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 in Status: UNINITIALIZED for 2s [ 810.068386] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 in Status: SUCCESS [ 810.068739] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.068850] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.069298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.069560] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.069742] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.069883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.070062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.070154] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.070274] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.147326] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97c8cce3-00c2-49b4-ba27-3aa965fac418 with status ACTIVE [ 810.149905] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.149905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.149905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.149905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.149905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.149905] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.149905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.149905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.149905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.149905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.149905] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.149905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.149905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.149905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.149905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.149905] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97c8cce3-00c2-49b4-ba27-3aa965fac418 is going to be updated. [ 810.177796] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.177796] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.177796] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.178102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.178102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.178235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97c8cce3-00c2-49b4-ba27-3aa965fac418" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.451771] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b539ffb-57a2-420e-8eb3-8a80c9021bc6: rpc.has_security_group_logging(os_id): False [ 810.471096] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.471352] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.471434] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.471634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.471723] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.472826] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.472935] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.473022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.473370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.473370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.473497] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 is going to be created. [ 810.546603] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.546804] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.546901] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.547258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.547902] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.562099] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 in Status: IN_PROGRESS for 2s [ 810.574841] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.078793] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.582727] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.582727] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.582727] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.582727] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.583238] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.583238] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 is going to be updated. [ 811.621949] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.622157] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.622211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.622426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.622582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.634399] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 in Status: IN_PROGRESS for 2s [ 812.033747] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 in Status: SUCCESS [ 812.033969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.034373] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.034514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.034590] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.034708] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.034765] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.034925] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.034994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.035123] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.035174] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00387676-9ba9-4227-8ddc-1da0bacf2f93',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.537615] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00387676-9ba9-4227-8ddc-1da0bacf2f93 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.537899] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.537899] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.538127] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.538304] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.538422] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.538469] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.538641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.538714] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.538806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.538978] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00387676-9ba9-4227-8ddc-1da0bacf2f93 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.539098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.539140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.539285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.539433] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.539545] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.539593] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.539855] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.539855] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.539979] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.540044] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00387676-9ba9-4227-8ddc-1da0bacf2f93',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.580047] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 in Status: SUCCESS [ 812.580348] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.043874] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00387676-9ba9-4227-8ddc-1da0bacf2f93: rpc.has_security_group_logging(os_id): False [ 813.073032] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.073032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.073032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.073032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.073032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.073032] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.073032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.073032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.073032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.073032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.073032] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.073032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.073032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.073032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.073032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.073745] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.073745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.073745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.073745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.073745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.073745] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 is going to be created. [ 813.140087] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.140679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.141119] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.142328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.142525] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.157422] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 in Status: IN_PROGRESS for 2s [ 813.214824] env[66519]: INFO networking_nsxv3.common.synchronization [None req-722ff1c7-f636-4b5c-bf16-56949a5fd7d2 tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 with Priority: HIGHEST for action security_group_rules [ 813.215604] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 with Priority: HIGHEST for action security_group_rules [ 813.216246] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.216433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.216433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.216848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.216965] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c204b4b3-a1d5-4736-9d79-b4de3adce0c8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.417448] env[66519]: INFO networking_nsxv3.common.synchronization [None req-744d8014-b8fb-4774-8e9f-e9d1028ff7b4 tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 with Priority: HIGHEST for action security_group_rules [ 813.420529] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 with Priority: HIGHEST for action security_group_rules [ 813.420529] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.420529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.550044] env[66519]: INFO networking_nsxv3.common.synchronization [None req-2c43195a-f189-4bc0-ac00-fe7943c96585 None None] Enqueued Resource ID: d807167d-be66-4c50-a8cc-93bbecfadf86 with Priority: HIGHEST for action port [ 813.551496] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d807167d-be66-4c50-a8cc-93bbecfadf86 with Priority: HIGHEST for action port [ 813.552637] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-d807167d-be66-4c50-a8cc-93bbecfadf86 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.552637] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d807167d-be66-4c50-a8cc-93bbecfadf86" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.552637] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d807167d-be66-4c50-a8cc-93bbecfadf86" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.552637] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d807167d-be66-4c50-a8cc-93bbecfadf86" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.553472] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d807167d-be66-4c50-a8cc-93bbecfadf86',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.645999] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 in Status: SUCCESS [ 813.645999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.645999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.645999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.645999] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.645999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.645999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.645999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.645999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.646496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.646496] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.647135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.647318] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.647473] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.647573] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.647711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.647841] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.647919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.648011] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.742207] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.742404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.742458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.742694] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.742819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.742923] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 already deleted. [ 813.743146] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.743222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.743328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.743409] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c204b4b3-a1d5-4736-9d79-b4de3adce0c8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.056600] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d807167d-be66-4c50-a8cc-93bbecfadf86 [ 814.056898] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.057097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.057097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.057359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.057567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.057735] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d807167d-be66-4c50-a8cc-93bbecfadf86 already deleted. [ 814.058082] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d807167d-be66-4c50-a8cc-93bbecfadf86" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.152500] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.153927] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.266230] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.266230] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.266230] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.266397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.266489] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.266584] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 already deleted. [ 814.266665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.288517] env[66519]: INFO networking_nsxv3.common.synchronization [req-487d5456-1f12-45ee-932c-2aca6d9c12c4 req-ed620148-da19-464f-9be6-20784206c8ff tempest-AttachInterfacesUnderV243Test-1907112666 tempest-AttachInterfacesUnderV243Test-1907112666-project-member] Enqueued Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_members [ 814.290689] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 with Priority: HIGHEST for action security_group_members [ 814.290689] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.290847] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.655492] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54b1272e-4345-4ee1-924d-5e0ad1e18bd8: rpc.has_security_group_logging(os_id): False [ 814.658285] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.676060] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.676060] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.676060] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.676273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.676321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.676576] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.676673] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.676741] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.676897] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.677398] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.677398] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 is going to be updated. [ 814.737489] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.737642] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.737693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.737904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.738064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.755488] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 in Status: IN_PROGRESS for 2s [ 815.161462] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.161753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.161753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.162063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.162137] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.162195] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 is going to be updated. [ 815.172574] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 in Status: SUCCESS [ 815.173040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.193056] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.193213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.193282] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.193997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.193997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.203492] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 in Status: IN_PROGRESS for 2s [ 815.924821] env[66519]: INFO networking_nsxv3.common.synchronization [None req-232024ed-d634-49b2-8a56-9205b013f6f0 None None] Enqueued Resource ID: 9541cfaa-b0b3-4bc0-a146-ec94ad74f5a7 with Priority: HIGHEST for action port [ 815.924990] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9541cfaa-b0b3-4bc0-a146-ec94ad74f5a7 with Priority: HIGHEST for action port [ 815.925320] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-9541cfaa-b0b3-4bc0-a146-ec94ad74f5a7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.925452] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9541cfaa-b0b3-4bc0-a146-ec94ad74f5a7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.925518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9541cfaa-b0b3-4bc0-a146-ec94ad74f5a7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.925767] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9541cfaa-b0b3-4bc0-a146-ec94ad74f5a7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.925847] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9541cfaa-b0b3-4bc0-a146-ec94ad74f5a7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.429859] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9541cfaa-b0b3-4bc0-a146-ec94ad74f5a7 [ 816.429859] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.429859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.429859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.429859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.429859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.429859] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9541cfaa-b0b3-4bc0-a146-ec94ad74f5a7 already deleted. [ 816.429859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9541cfaa-b0b3-4bc0-a146-ec94ad74f5a7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.774437] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 in Status: SUCCESS [ 816.774814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.775282] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.775563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.775751] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.944108] env[66519]: INFO networking_nsxv3.common.synchronization [req-666defa9-1378-4250-9d97-59ca80381980 req-29a42a28-c2d6-4f9e-8936-eca24decbc44 tempest-ListImageFiltersTestJSON-725451738 tempest-ListImageFiltersTestJSON-725451738-project-member] Enqueued Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGHEST for action security_group_members [ 816.945190] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGHEST for action security_group_members [ 816.945190] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.945386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.945945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.946215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.946656] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.946656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.946656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.946794] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.946866] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.946961] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.216157] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 in Status: IN_PROGRESS for 4s [ 817.298114] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.298114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.298114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.298114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.298114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.298114] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 is going to be deleted. [ 817.359753] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.359753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.359753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.359753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.359753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.359753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.449880] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.450280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.450280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.450280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.450280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.450564] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.450701] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.450776] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.450925] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.451014] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.451108] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce52e424-4971-4af0-bb7e-19455530de2e is going to be updated. [ 817.498164] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.498164] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.498164] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.498386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.498665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.507749] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce52e424-4971-4af0-bb7e-19455530de2e in Status: IN_PROGRESS for 2s [ 818.379885] env[66519]: INFO networking_nsxv3.common.synchronization [req-4ada7d52-7e97-43b2-bb61-7c0ddd887792 req-2240b897-3f9d-48cd-a0a4-781791cc2ea1 tempest-ImagesOneServerNegativeTestJSON-1631615325 tempest-ImagesOneServerNegativeTestJSON-1631615325-project-member] Enqueued Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_members [ 818.380537] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_members [ 818.380760] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.383904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.383904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.383904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.383904] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.383904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.383904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.383904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.383904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.383904] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.752246] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-889 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.752533] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-889" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.752533] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-889" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.752676] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-889" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.752950] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.753125] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.753238] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.753454] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.753597] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.753802] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 818.753911] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 818.754029] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 818.754138] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 818.754246] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 818.754347] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 818.754476] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 818.773973] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 818.774245] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 818.774426] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 818.774729] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-889" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.775059] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-a3cc151c-78b6-4ac8-9305-2f3439918b11 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.775239] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-a3cc151c-78b6-4ac8-9305-2f3439918b11" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.775360] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-a3cc151c-78b6-4ac8-9305-2f3439918b11" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.775662] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-a3cc151c-78b6-4ac8-9305-2f3439918b11" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.775799] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3cc151c-78b6-4ac8-9305-2f3439918b11',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.883894] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.885016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.885016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.885016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.907205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.907448] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.907574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.907637] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.907836] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.907916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.908016] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ed5e58-fb42-4430-8674-e9d732009460 is going to be updated. [ 818.946956] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.946956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.946956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.946956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.946956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.956412] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: IN_PROGRESS for 2s [ 819.228218] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 in Status: SUCCESS [ 819.228218] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.228218] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.228389] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.228492] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.228567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.228648] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.228798] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.228879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.228973] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.278991] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.279288] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.280052] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.280052] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.280052] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.280052] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port a3cc151c-78b6-4ac8-9305-2f3439918b11 not found, creating... [ 819.280285] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.280508] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.280777] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.281050] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.281199] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.281492] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.281645] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.281758] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.281957] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.282105] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.282246] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: a3cc151c-78b6-4ac8-9305-2f3439918b11 is going to be created. [ 819.314862] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.315114] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.315262] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.315528] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.315755] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.315983] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-a3cc151c-78b6-4ac8-9305-2f3439918b11" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.518122] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ce52e424-4971-4af0-bb7e-19455530de2e in Status: SUCCESS [ 819.518313] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ce52e424-4971-4af0-bb7e-19455530de2e deletion is rescheduled due to dependency. [ 819.518433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.731248] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.731449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.731561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.731875] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.732059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.732247] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.732352] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.732410] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.732528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.732605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.732690] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 is going to be deleted. [ 819.788375] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.788375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.788375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.788375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.788375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.788977] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.789049] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.789414] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.790315] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.790315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.790315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.790505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.790634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.791192] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54b1272e-4345-4ee1-924d-5e0ad1e18bd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.042230] env[66519]: INFO networking_nsxv3.common.synchronization [req-4ada7d52-7e97-43b2-bb61-7c0ddd887792 req-5acd5faf-1b32-40b3-883d-c804a2849969 service nova] Enqueued Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_rules [ 820.042230] env[66519]: INFO networking_nsxv3.common.synchronization [req-4ada7d52-7e97-43b2-bb61-7c0ddd887792 req-5acd5faf-1b32-40b3-883d-c804a2849969 service nova] Enqueued Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_members [ 820.042230] env[66519]: INFO networking_nsxv3.common.synchronization [req-4ada7d52-7e97-43b2-bb61-7c0ddd887792 req-5acd5faf-1b32-40b3-883d-c804a2849969 service nova] Enqueued Resource ID: a3cc151c-78b6-4ac8-9305-2f3439918b11 with Priority: HIGHEST for action port [ 820.042230] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_rules [ 820.042230] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_members [ 820.042230] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3cc151c-78b6-4ac8-9305-2f3439918b11 with Priority: HIGHEST for action port [ 820.042763] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.042763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.042763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.042899] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.042899] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.044078] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.044299] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.044519] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3cc151c-78b6-4ac8-9305-2f3439918b11 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.044619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3cc151c-78b6-4ac8-9305-2f3439918b11" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.044680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3cc151c-78b6-4ac8-9305-2f3439918b11" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.044972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3cc151c-78b6-4ac8-9305-2f3439918b11" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.045060] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3cc151c-78b6-4ac8-9305-2f3439918b11',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.294377] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.294577] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.294696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.294961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.295104] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.295326] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.295432] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.295497] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.295663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.295741] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.295825] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54b1272e-4345-4ee1-924d-5e0ad1e18bd8 already deleted. [ 820.295904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54b1272e-4345-4ee1-924d-5e0ad1e18bd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.547239] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3cc151c-78b6-4ac8-9305-2f3439918b11 with status ACTIVE [ 820.547435] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.547435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.547562] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.547663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.547845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.548042] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.548148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.548258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.548393] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.548450] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.548691] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.548798] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.548859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.549008] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.549092] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.549171] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3cc151c-78b6-4ac8-9305-2f3439918b11 is going to be updated. [ 820.550843] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.550953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.573970] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.574220] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.574276] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.575200] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.575200] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.575200] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3cc151c-78b6-4ac8-9305-2f3439918b11" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.969212] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: SUCCESS [ 820.972821] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ed5e58-fb42-4430-8674-e9d732009460 deletion is rescheduled due to dependency. [ 820.972821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.972821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.972821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.972821] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.972821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.972821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.972821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.972821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.972821] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.472987] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.975358] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.478275] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.478482] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.478544] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.478810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.478932] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.479082] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ed5e58-fb42-4430-8674-e9d732009460 is going to be updated. [ 822.506709] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.506850] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.506916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.507193] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.507349] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.516275] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: IN_PROGRESS for 2s [ 822.996492] env[66519]: INFO networking_nsxv3.common.synchronization [req-7bac781d-8588-4637-b57e-9817d69c00f7 req-9612c426-a913-48be-9d0e-d2dfbafbe454 tempest-AttachInterfacesV270Test-64898659 tempest-AttachInterfacesV270Test-64898659-project-member] Enqueued Resource ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 with Priority: HIGHEST for action security_group_members [ 822.998159] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 with Priority: HIGHEST for action security_group_members [ 822.998159] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00387676-9ba9-4227-8ddc-1da0bacf2f93 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.998159] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.998159] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.998634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.998634] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.998634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.998634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.998790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.998790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.998891] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00387676-9ba9-4227-8ddc-1da0bacf2f93',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.159613] env[66519]: INFO networking_nsxv3.common.synchronization [req-704726d6-ab04-411a-b9bd-21f9c356fcb0 req-705b0659-ab7b-4d5a-bc60-2c6087e69f2d tempest-ImagesTestJSON-1420515381 tempest-ImagesTestJSON-1420515381-project-member] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 823.160196] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 823.160463] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.160583] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.160646] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.160842] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.160991] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.164988] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.165532] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.165743] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.165840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.165942] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.501494] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.501668] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.501788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.502140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.502228] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.502485] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.502602] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.502700] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.502921] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.503065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.503184] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 is going to be updated. [ 823.532727] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.535732] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.535732] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.535732] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.535732] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.543931] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-161 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.544137] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.544259] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.544529] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.544797] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.545032] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.545174] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.545403] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.545569] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.545791] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.545907] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 823.546024] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 823.546178] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 823.546280] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.546403] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 823.546566] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 823.550094] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 in Status: IN_PROGRESS for 2s [ 823.568049] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 823.568049] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 823.568374] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 823.568483] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.568876] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-69ede1e9-ee78-4f7b-ab3f-1eadebfa45ed taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.569102] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-69ede1e9-ee78-4f7b-ab3f-1eadebfa45ed" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.569246] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-69ede1e9-ee78-4f7b-ab3f-1eadebfa45ed" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.569630] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-69ede1e9-ee78-4f7b-ab3f-1eadebfa45ed" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.569785] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69ede1e9-ee78-4f7b-ab3f-1eadebfa45ed',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.669957] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.670181] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.670245] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.670463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.670528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.670717] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.670821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.670884] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.671046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.671125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.671215] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be deleted. [ 823.700912] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.701093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.701163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.701353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.701444] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.701640] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.072540] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.072966] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.072966] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.073199] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.073347] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.073506] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 69ede1e9-ee78-4f7b-ab3f-1eadebfa45ed not found, creating... [ 824.073752] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.073908] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.074102] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.074333] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.074503] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.074791] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.074943] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.075069] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.075279] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.075405] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.075535] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 69ede1e9-ee78-4f7b-ab3f-1eadebfa45ed is going to be created. [ 824.095980] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.096306] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.096442] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.096720] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.096951] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.097250] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-69ede1e9-ee78-4f7b-ab3f-1eadebfa45ed" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.526247] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: SUCCESS [ 824.526513] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.526680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.526894] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.527101] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.527218] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.527323] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.527466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.527547] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.527643] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.527738] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.838692] env[66519]: INFO networking_nsxv3.common.synchronization [req-704726d6-ab04-411a-b9bd-21f9c356fcb0 req-6a3e8ddb-bd39-4725-997c-3cfbcba9a486 service nova] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_rules [ 824.839329] env[66519]: INFO networking_nsxv3.common.synchronization [req-704726d6-ab04-411a-b9bd-21f9c356fcb0 req-6a3e8ddb-bd39-4725-997c-3cfbcba9a486 service nova] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 824.839329] env[66519]: INFO networking_nsxv3.common.synchronization [req-704726d6-ab04-411a-b9bd-21f9c356fcb0 req-6a3e8ddb-bd39-4725-997c-3cfbcba9a486 service nova] Enqueued Resource ID: 69ede1e9-ee78-4f7b-ab3f-1eadebfa45ed with Priority: HIGHEST for action port [ 824.839643] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_rules [ 824.839643] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 824.839643] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ede1e9-ee78-4f7b-ab3f-1eadebfa45ed with Priority: HIGHEST for action port [ 824.840332] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.840332] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.840332] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.840332] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.840669] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.841988] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.842175] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.842246] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.842429] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.843103] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.843103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.843103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.843330] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.843330] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.843446] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.844818] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-69ede1e9-ee78-4f7b-ab3f-1eadebfa45ed taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.844818] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69ede1e9-ee78-4f7b-ab3f-1eadebfa45ed" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.844818] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69ede1e9-ee78-4f7b-ab3f-1eadebfa45ed" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.844818] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69ede1e9-ee78-4f7b-ab3f-1eadebfa45ed" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.844818] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69ede1e9-ee78-4f7b-ab3f-1eadebfa45ed',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.029698] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.029894] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.029993] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.030239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.030421] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.030522] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.030589] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.030730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.030813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.030910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.031134] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.031238] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.031302] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.031479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.031659] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.031783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.031858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.031979] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.032072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.032149] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.032238] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.346988] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.348031] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.348031] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.348031] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 69ede1e9-ee78-4f7b-ab3f-1eadebfa45ed with status ACTIVE [ 825.348031] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.348031] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.348348] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.348348] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.348433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.348538] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.348637] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.348698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.348858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.349126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.349399] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.349465] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.349504] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.349640] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.349715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.349801] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 69ede1e9-ee78-4f7b-ab3f-1eadebfa45ed is going to be updated. [ 825.372519] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.372660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.372706] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.372912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.373593] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.373593] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69ede1e9-ee78-4f7b-ab3f-1eadebfa45ed" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.535602] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9ed5e58-fb42-4430-8674-e9d732009460: rpc.has_security_group_logging(os_id): False [ 825.559899] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.560657] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.560796] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.561235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.561521] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.562092] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.562092] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.562092] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.562324] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.562366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.562548] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.562644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.562710] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.562853] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.563016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.563231] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.563327] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.563388] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.563529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.563615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.563702] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9ed5e58-fb42-4430-8674-e9d732009460 is going to be updated. [ 825.565812] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 in Status: SUCCESS [ 825.566026] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 deletion is rescheduled due to dependency. [ 825.566145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.631620] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.631620] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.631806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.632659] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.632659] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.650486] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: IN_PROGRESS for 2s [ 825.851837] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.355516] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.355516] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.355888] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.356787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.356787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.356941] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be created. [ 826.382436] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.382678] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.382678] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.382915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.383087] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.393682] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: UNINITIALIZED for 2s [ 827.665882] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: SUCCESS [ 827.666251] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.853855] env[66519]: INFO networking_nsxv3.common.synchronization [req-0807eb8e-a1ad-4ff7-89a8-e07480630995 req-34a466f8-0ba6-4f04-b9cb-ed32fcfa1d44 tempest-ServersTestJSON-971253557 tempest-ServersTestJSON-971253557-project-member] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 827.853998] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 827.855252] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.855252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.855252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.855252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.855252] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.855252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.856350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.858848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.858848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.858848] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.221247] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-450 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.221468] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.221591] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.221920] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.222197] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.222459] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.222598] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.222882] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.223048] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.223266] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.223378] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.223485] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.223589] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.223691] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.223791] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.223920] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.248111] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.248111] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 828.248375] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.248375] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.249015] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-e52135f4-999e-4c43-94d6-41d1abd7b129 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.249258] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-e52135f4-999e-4c43-94d6-41d1abd7b129" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.249351] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-e52135f4-999e-4c43-94d6-41d1abd7b129" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.249807] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-e52135f4-999e-4c43-94d6-41d1abd7b129" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.250063] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e52135f4-999e-4c43-94d6-41d1abd7b129',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.361693] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.361693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.361693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.361693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.361693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.361693] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.361973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.361973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.362251] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.362375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.362424] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 already deleted. [ 828.362537] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.404380] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: SUCCESS [ 828.404623] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.404830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.405097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.405302] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.405446] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.405523] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.405692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.405775] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.405862] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.406027] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.753038] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.753368] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.753446] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.753714] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.753855] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.754009] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port e52135f4-999e-4c43-94d6-41d1abd7b129 not found, creating... [ 828.754306] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.754475] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.754609] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.754847] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.754982] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.755284] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.755459] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.755571] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.755768] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.755897] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.756066] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: e52135f4-999e-4c43-94d6-41d1abd7b129 is going to be created. [ 828.779953] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.780231] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.780387] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.780687] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.780954] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.781255] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-e52135f4-999e-4c43-94d6-41d1abd7b129" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.908952] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.909156] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.909244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.909506] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.909694] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.909802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.909866] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.910058] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.910176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.910292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.910566] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.910710] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.910777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.910946] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.911117] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.911226] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.911288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.911432] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.911509] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.911606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.911698] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.414219] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c93d149b-db2a-420d-81f5-177c6bdd9505: rpc.has_security_group_logging(os_id): False [ 829.434364] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.434572] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.434656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.434908] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.435031] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.435287] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.435425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.435514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.435766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.435866] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.436119] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.436251] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.436343] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.436525] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.436615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.436900] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.437367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.437502] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.437666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.437747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.437838] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be created. [ 829.495855] env[66519]: INFO networking_nsxv3.common.synchronization [req-0807eb8e-a1ad-4ff7-89a8-e07480630995 req-414f87c1-dceb-4888-88ea-49584da870af service nova] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_rules [ 829.496053] env[66519]: INFO networking_nsxv3.common.synchronization [req-0807eb8e-a1ad-4ff7-89a8-e07480630995 req-414f87c1-dceb-4888-88ea-49584da870af service nova] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 829.496250] env[66519]: INFO networking_nsxv3.common.synchronization [req-0807eb8e-a1ad-4ff7-89a8-e07480630995 req-414f87c1-dceb-4888-88ea-49584da870af service nova] Enqueued Resource ID: e52135f4-999e-4c43-94d6-41d1abd7b129 with Priority: HIGHEST for action port [ 829.496752] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_rules [ 829.498192] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 829.498322] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e52135f4-999e-4c43-94d6-41d1abd7b129 with Priority: HIGHEST for action port [ 829.499462] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.499631] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.499667] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.500373] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.500507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.501956] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.501956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.501956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.502209] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.502209] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.503056] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.503167] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.503275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.503559] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.503709] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.503966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.504410] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.505180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.505180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.505180] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.506618] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-e52135f4-999e-4c43-94d6-41d1abd7b129 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.506618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e52135f4-999e-4c43-94d6-41d1abd7b129" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.506618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e52135f4-999e-4c43-94d6-41d1abd7b129" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.506618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e52135f4-999e-4c43-94d6-41d1abd7b129" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.506618] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e52135f4-999e-4c43-94d6-41d1abd7b129',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.520972] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: IN_PROGRESS for 2s [ 830.010313] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.010313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.010313] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.010313] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e52135f4-999e-4c43-94d6-41d1abd7b129 with status ACTIVE [ 830.010313] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.010313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.010313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.010313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.010313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.011184] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.011184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.011184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.011184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.011184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.011404] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.011457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.011560] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.012195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.012195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.012995] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e52135f4-999e-4c43-94d6-41d1abd7b129 is going to be updated. [ 830.045033] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.045469] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.045544] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.045752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.045911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.046224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e52135f4-999e-4c43-94d6-41d1abd7b129" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.516495] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.020656] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.020656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.020656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.020656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.020656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.020656] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be created. [ 831.060035] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.060035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.060035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.060287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.060912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.074053] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: UNINITIALIZED for 2s [ 831.540476] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: SUCCESS [ 831.540662] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.088638] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 833.088638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.088638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.088638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.088638] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.088638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.088638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.088638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.088638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.088638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.088638] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.592174] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.592402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.592482] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.592764] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.592960] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.593088] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.593179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.593401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.593523] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.593638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.593972] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.593972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.594155] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.594393] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.594532] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.594629] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.594688] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.594830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.594990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.595113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.595212] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.960904] env[66519]: INFO networking_nsxv3.common.synchronization [None req-372b1bef-9b1f-45f2-9333-a68459a68d8c None None] Enqueued Resource ID: 16a4513f-d249-4281-8c0f-30d6cd393152 with Priority: HIGHEST for action port [ 833.961530] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16a4513f-d249-4281-8c0f-30d6cd393152 with Priority: HIGHEST for action port [ 833.965053] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-16a4513f-d249-4281-8c0f-30d6cd393152 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.965053] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16a4513f-d249-4281-8c0f-30d6cd393152" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.965053] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16a4513f-d249-4281-8c0f-30d6cd393152" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.966114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16a4513f-d249-4281-8c0f-30d6cd393152" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.966961] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16a4513f-d249-4281-8c0f-30d6cd393152',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.098338] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb1cadf6-d26e-4714-b83e-0fcbe235e2e5: rpc.has_security_group_logging(os_id): False [ 834.118864] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.119634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.119634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.119852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.120042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.121040] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.121261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.121261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.121462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.121462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.121673] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.123565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.123704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.123864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.123951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.124298] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.124474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.124585] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.124690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.124783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.124913] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be created. [ 834.194295] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.196063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.196063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.196063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.196063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.209535] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 834.469674] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16a4513f-d249-4281-8c0f-30d6cd393152 [ 834.469674] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.469817] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.469817] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.470073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.470178] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.470282] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16a4513f-d249-4281-8c0f-30d6cd393152 already deleted. [ 834.470409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16a4513f-d249-4281-8c0f-30d6cd393152" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.168876] env[66519]: INFO networking_nsxv3.common.synchronization [req-79709b21-c03e-422a-8ea9-b410c79ada33 req-bfeda92d-63a9-453e-8b99-8564b0d9b6ae tempest-FloatingIPsAssociationTestJSON-1821391314 tempest-FloatingIPsAssociationTestJSON-1821391314-project-member] Enqueued Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGHEST for action security_group_members [ 835.169460] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGHEST for action security_group_members [ 835.169797] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.169925] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.170201] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.170428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.171139] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.171139] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.171139] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.171139] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.171139] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.171139] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.621114] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-943 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.621364] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-943" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.621520] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-943" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.621828] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-943" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.622141] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.622335] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.622489] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.622741] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.622926] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.623182] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 835.623322] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 835.623466] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 835.623658] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 835.623725] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 835.623863] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 835.624034] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.647230] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.647302] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 835.647411] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.647589] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-943" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.647903] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-172b757b-884e-4201-a3aa-9cf827378216 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.648086] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-172b757b-884e-4201-a3aa-9cf827378216" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.648206] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-172b757b-884e-4201-a3aa-9cf827378216" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.648556] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-172b757b-884e-4201-a3aa-9cf827378216" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.648705] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('172b757b-884e-4201-a3aa-9cf827378216',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.674532] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.155797] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.156090] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.156194] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.156663] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.156916] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.157111] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 172b757b-884e-4201-a3aa-9cf827378216 not found, creating... [ 836.157444] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.157650] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.157753] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.157999] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.158154] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.158463] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.158699] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.158817] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.159044] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.159178] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.159313] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 172b757b-884e-4201-a3aa-9cf827378216 is going to be created. [ 836.177470] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.182883] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.183101] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.183242] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.183697] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.183697] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.184019] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-172b757b-884e-4201-a3aa-9cf827378216" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.244087] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 836.244438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.333578] env[66519]: INFO networking_nsxv3.common.synchronization [None req-9127cffb-b342-42d7-ad53-0220218890ab None None] Enqueued Resource ID: c63c0f55-c35f-4739-8013-1c487fea6b79 with Priority: HIGHEST for action port [ 836.333578] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c63c0f55-c35f-4739-8013-1c487fea6b79 with Priority: HIGHEST for action port [ 836.333751] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-c63c0f55-c35f-4739-8013-1c487fea6b79 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.334227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c63c0f55-c35f-4739-8013-1c487fea6b79" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.334227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c63c0f55-c35f-4739-8013-1c487fea6b79" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.334227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c63c0f55-c35f-4739-8013-1c487fea6b79" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.334385] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c63c0f55-c35f-4739-8013-1c487fea6b79',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.682736] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.682736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.682736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.682736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.682736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.682736] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34191aa8-8997-42e0-88cc-151380dc439e is going to be updated. [ 836.712144] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.712726] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.712959] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.713957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.714455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.733396] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34191aa8-8997-42e0-88cc-151380dc439e in Status: IN_PROGRESS for 2s [ 836.836312] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c63c0f55-c35f-4739-8013-1c487fea6b79 [ 836.837865] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.837865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.837865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.837865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.837865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.837865] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c63c0f55-c35f-4739-8013-1c487fea6b79 already deleted. [ 836.837865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c63c0f55-c35f-4739-8013-1c487fea6b79" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.973715] env[66519]: INFO networking_nsxv3.common.synchronization [req-79709b21-c03e-422a-8ea9-b410c79ada33 req-3102f90e-7009-4a62-8a01-792bda15b446 service nova] Enqueued Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGHEST for action security_group_rules [ 836.974680] env[66519]: INFO networking_nsxv3.common.synchronization [req-79709b21-c03e-422a-8ea9-b410c79ada33 req-3102f90e-7009-4a62-8a01-792bda15b446 service nova] Enqueued Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGHEST for action security_group_members [ 836.974680] env[66519]: INFO networking_nsxv3.common.synchronization [req-79709b21-c03e-422a-8ea9-b410c79ada33 req-3102f90e-7009-4a62-8a01-792bda15b446 service nova] Enqueued Resource ID: 172b757b-884e-4201-a3aa-9cf827378216 with Priority: HIGHEST for action port [ 836.975071] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGHEST for action security_group_rules [ 836.975071] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGHEST for action security_group_members [ 836.975071] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 172b757b-884e-4201-a3aa-9cf827378216 with Priority: HIGHEST for action port [ 836.975472] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.975604] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.975604] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.975871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.975871] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.977175] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.977324] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.977487] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-172b757b-884e-4201-a3aa-9cf827378216 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.979400] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-172b757b-884e-4201-a3aa-9cf827378216" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.979400] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-172b757b-884e-4201-a3aa-9cf827378216" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.979400] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-172b757b-884e-4201-a3aa-9cf827378216" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.979400] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('172b757b-884e-4201-a3aa-9cf827378216',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.483699] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.483990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.484338] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 172b757b-884e-4201-a3aa-9cf827378216 with status ACTIVE [ 837.484550] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.484665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.484774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.485073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.485172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.485334] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.485518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.485518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.485671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.485743] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.485918] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.486035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.486093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.486231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.486345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.486432] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 172b757b-884e-4201-a3aa-9cf827378216 is going to be updated. [ 837.515883] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.515883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.515883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.516162] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.516162] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.516301] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-172b757b-884e-4201-a3aa-9cf827378216" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.748139] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34191aa8-8997-42e0-88cc-151380dc439e in Status: SUCCESS [ 838.748479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.748666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.748913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.749154] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.749280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.749713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.749713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.749713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.749713] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.253973] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.756581] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.983924] env[66519]: INFO networking_nsxv3.common.synchronization [req-6e33eff2-8260-4ab3-85ed-370381208ecc req-1f879d5e-fc2b-4d0e-9e82-5d538af68241 tempest-ServerActionsTestOtherA-1261634680 tempest-ServerActionsTestOtherA-1261634680-project-member] Enqueued Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_members [ 839.984601] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_members [ 839.984929] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a766da37-b2e2-4b4b-a76f-5622297330c4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.985081] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.985153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.985563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.985563] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.985660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.985998] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.985998] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.985998] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.986227] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.040502] env[66519]: INFO networking_nsxv3.common.synchronization [req-940e9e49-d031-40ff-8447-cece4c8d4e90 req-e45eca9f-5dac-4a66-b783-7e8f9ef991e0 tempest-ListServerFiltersTestJSON-365692851 tempest-ListServerFiltersTestJSON-365692851-project-member] Enqueued Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_members [ 840.040502] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_members [ 840.040502] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.040776] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.040776] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.040876] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.041053] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.041166] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.041229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.041405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.041497] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.041595] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.259362] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.259362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.259362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.259362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.259704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.259704] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34191aa8-8997-42e0-88cc-151380dc439e is going to be updated. [ 840.297513] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.297883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.301704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.301704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.301704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.311797] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34191aa8-8997-42e0-88cc-151380dc439e in Status: IN_PROGRESS for 2s [ 840.444275] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-320 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.444604] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.444830] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.445179] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.445527] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.445778] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.445864] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.446170] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.446341] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.446616] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.446732] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 840.446896] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 840.447017] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 840.447062] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.447205] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 840.447368] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 840.470516] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 840.470716] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 840.470818] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 840.471681] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.471681] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-fedc982a-7460-40d6-97fe-a7e93b9ef5f1 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.471681] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-fedc982a-7460-40d6-97fe-a7e93b9ef5f1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.471681] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-fedc982a-7460-40d6-97fe-a7e93b9ef5f1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.472120] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-fedc982a-7460-40d6-97fe-a7e93b9ef5f1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.472207] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fedc982a-7460-40d6-97fe-a7e93b9ef5f1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.486756] env[66519]: INFO networking_nsxv3.common.synchronization [req-3a51d988-d2ed-45a4-abd3-8c468a115bad req-abc8ecab-a0e1-40bf-bf55-f670f09f3d6f tempest-ImagesOneServerNegativeTestJSON-1631615325 tempest-ImagesOneServerNegativeTestJSON-1631615325-project-member] Enqueued Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_members [ 840.487797] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_members [ 840.488169] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.488377] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.488453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.489108] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.489108] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.489292] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.489408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.489408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.489728] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.489851] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.489993] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a766da37-b2e2-4b4b-a76f-5622297330c4 already deleted. [ 840.490137] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.490477] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.490661] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.490800] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.491052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.491277] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.491418] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.491505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.491676] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.491758] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.491851] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.544814] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.974910] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.975258] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.975340] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.975642] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.975805] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.975959] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port fedc982a-7460-40d6-97fe-a7e93b9ef5f1 not found, creating... [ 840.976363] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.976632] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.976721] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.976948] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.977148] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.977446] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.977600] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.977746] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.977967] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.978118] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.978346] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: fedc982a-7460-40d6-97fe-a7e93b9ef5f1 is going to be created. [ 840.995293] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.995748] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.995927] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.996415] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.996635] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.997243] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.997544] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.997649] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.997937] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.998083] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.998250] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ed5e58-fb42-4430-8674-e9d732009460 is going to be updated. [ 841.003191] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.003818] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.004126] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.004877] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.005329] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.005836] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-fedc982a-7460-40d6-97fe-a7e93b9ef5f1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.039904] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.040376] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.040376] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.040606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.040787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.048021] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.070456] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: IN_PROGRESS for 2s [ 841.551607] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.551607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.551607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.552215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.552392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.552582] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8806842e-05bb-42d4-891f-7827a3b60a33 is going to be updated. [ 841.597819] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.598032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.598173] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.598333] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.598483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.612461] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: IN_PROGRESS for 2s [ 841.803026] env[66519]: INFO networking_nsxv3.common.synchronization [req-6e33eff2-8260-4ab3-85ed-370381208ecc req-38054bdb-aaae-4481-8e79-31a2a06d2068 service nova] Enqueued Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_rules [ 841.807025] env[66519]: INFO networking_nsxv3.common.synchronization [req-6e33eff2-8260-4ab3-85ed-370381208ecc req-38054bdb-aaae-4481-8e79-31a2a06d2068 service nova] Enqueued Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_members [ 841.807025] env[66519]: INFO networking_nsxv3.common.synchronization [req-6e33eff2-8260-4ab3-85ed-370381208ecc req-38054bdb-aaae-4481-8e79-31a2a06d2068 service nova] Enqueued Resource ID: fedc982a-7460-40d6-97fe-a7e93b9ef5f1 with Priority: HIGHEST for action port [ 841.807025] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_rules [ 841.807025] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_members [ 841.807025] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fedc982a-7460-40d6-97fe-a7e93b9ef5f1 with Priority: HIGHEST for action port [ 841.807025] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a766da37-b2e2-4b4b-a76f-5622297330c4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.807025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.807025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.807025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.807025] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.807025] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a766da37-b2e2-4b4b-a76f-5622297330c4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.807025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.807025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.807025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.808115] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.811319] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.811319] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.811319] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.811319] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.811319] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.811319] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-fedc982a-7460-40d6-97fe-a7e93b9ef5f1 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.811319] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fedc982a-7460-40d6-97fe-a7e93b9ef5f1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.811319] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fedc982a-7460-40d6-97fe-a7e93b9ef5f1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.811319] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fedc982a-7460-40d6-97fe-a7e93b9ef5f1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.811319] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fedc982a-7460-40d6-97fe-a7e93b9ef5f1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.314741] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.316011] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a766da37-b2e2-4b4b-a76f-5622297330c4 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.316011] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.316011] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fedc982a-7460-40d6-97fe-a7e93b9ef5f1 with status ACTIVE [ 842.316011] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.316011] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.316299] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.316397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.316490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.316679] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.317275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.317275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.317275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.317275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.317482] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.317552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.317614] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.317773] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.318381] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.318381] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fedc982a-7460-40d6-97fe-a7e93b9ef5f1 is going to be updated. [ 842.332024] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34191aa8-8997-42e0-88cc-151380dc439e in Status: SUCCESS [ 842.332024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.332250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.332435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.332734] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.332914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.333027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.333300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.333439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.333577] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.333721] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.352325] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.353204] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.353348] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.353691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.353911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.354186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fedc982a-7460-40d6-97fe-a7e93b9ef5f1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.820876] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.836337] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.836537] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.836647] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.836845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.837024] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.837127] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.837185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.837341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.837532] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.837532] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.837748] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.837885] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.837975] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.838199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.838352] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.838467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.838532] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.838681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.838758] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.838839] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.838926] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.081993] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: SUCCESS [ 843.082205] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ed5e58-fb42-4430-8674-e9d732009460 deletion is rescheduled due to dependency. [ 843.082377] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.323036] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.323361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.323361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.323522] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.323606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.323708] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a766da37-b2e2-4b4b-a76f-5622297330c4 is going to be created. [ 843.340892] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34191aa8-8997-42e0-88cc-151380dc439e: rpc.has_security_group_logging(os_id): False [ 843.360014] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.360260] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.360330] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.360529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.360750] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.362902] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.363094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.363155] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.363400] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.363675] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.363766] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.363918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.363987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.364237] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.364492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.364753] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.364871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.364959] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.365201] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.365288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.365498] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.365606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.365685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.365856] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.365954] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.366081] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34191aa8-8997-42e0-88cc-151380dc439e is going to be updated. [ 843.377248] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a766da37-b2e2-4b4b-a76f-5622297330c4 in Status: UNINITIALIZED for 2s [ 843.439482] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.439749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.439749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.439965] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.440105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.462703] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34191aa8-8997-42e0-88cc-151380dc439e in Status: IN_PROGRESS for 2s [ 843.628080] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: SUCCESS [ 843.628321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.389713] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a766da37-b2e2-4b4b-a76f-5622297330c4 in Status: SUCCESS [ 845.389713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.389713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.389713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.389713] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.389713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.389713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.389713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.389713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.389713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.389713] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.485482] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34191aa8-8997-42e0-88cc-151380dc439e in Status: SUCCESS [ 845.485482] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.891876] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.395390] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a766da37-b2e2-4b4b-a76f-5622297330c4: rpc.has_security_group_logging(os_id): False [ 846.413753] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.413936] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.413936] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.414078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.414164] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.414413] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.414554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.414554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.414711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.414781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.414864] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a766da37-b2e2-4b4b-a76f-5622297330c4 is going to be created. [ 846.496901] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.496901] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.496901] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.497195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.497195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.508918] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a766da37-b2e2-4b4b-a76f-5622297330c4 in Status: IN_PROGRESS for 2s [ 846.806075] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 846.806346] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 848.525798] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a766da37-b2e2-4b4b-a76f-5622297330c4 in Status: SUCCESS [ 848.526282] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.596835] env[66519]: INFO networking_nsxv3.common.synchronization [req-ba919176-ecd3-48f9-93a9-d1ab5e651306 req-6d895ec6-731a-49ab-86e3-618d139b5f89 tempest-ServersNegativeTestMultiTenantJSON-453304481 tempest-ServersNegativeTestMultiTenantJSON-453304481-project-member] Enqueued Resource ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 with Priority: HIGHEST for action security_group_members [ 849.598149] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 with Priority: HIGHEST for action security_group_members [ 849.599476] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ce9371-2113-4da6-8d86-1fcee6902f41 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.599476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.599476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.599476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.599476] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.599476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.599476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.600241] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.600241] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.600241] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76ce9371-2113-4da6-8d86-1fcee6902f41',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.106091] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.106261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.106365] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.106618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.106716] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.106926] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.107119] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.107119] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.107247] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.107374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.107485] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 already deleted. [ 850.107485] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.175657] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.176108] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-657" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.176379] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-657" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.176871] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-657" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.177537] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.177895] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.178173] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.178509] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.178845] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.179181] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.179399] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.179618] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.179818] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.180030] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.181598] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.181598] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 850.201501] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 850.201501] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 850.201749] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 850.201749] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-657" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.202121] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-9b6c7d7b-07d5-4e5c-94b3-85fa340dc3ad taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.202305] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-9b6c7d7b-07d5-4e5c-94b3-85fa340dc3ad" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.202403] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-9b6c7d7b-07d5-4e5c-94b3-85fa340dc3ad" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.202809] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-9b6c7d7b-07d5-4e5c-94b3-85fa340dc3ad" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.202809] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b6c7d7b-07d5-4e5c-94b3-85fa340dc3ad',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.705905] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.706271] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.706445] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.706768] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.706986] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.707172] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 9b6c7d7b-07d5-4e5c-94b3-85fa340dc3ad not found, creating... [ 850.707497] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.707673] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.707789] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.708015] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.708159] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.708443] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.708595] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.708734] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.709023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.709594] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.709761] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 9b6c7d7b-07d5-4e5c-94b3-85fa340dc3ad is going to be created. [ 850.731840] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.731840] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.731840] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.732167] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.732360] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.732589] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-9b6c7d7b-07d5-4e5c-94b3-85fa340dc3ad" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.489948] env[66519]: INFO networking_nsxv3.common.synchronization [req-ba919176-ecd3-48f9-93a9-d1ab5e651306 req-f4ed897a-051b-4aa5-9320-14cb08629f11 service nova] Enqueued Resource ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 with Priority: HIGHEST for action security_group_rules [ 851.490244] env[66519]: INFO networking_nsxv3.common.synchronization [req-ba919176-ecd3-48f9-93a9-d1ab5e651306 req-f4ed897a-051b-4aa5-9320-14cb08629f11 service nova] Enqueued Resource ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 with Priority: HIGHEST for action security_group_members [ 851.490576] env[66519]: INFO networking_nsxv3.common.synchronization [req-ba919176-ecd3-48f9-93a9-d1ab5e651306 req-f4ed897a-051b-4aa5-9320-14cb08629f11 service nova] Enqueued Resource ID: 9b6c7d7b-07d5-4e5c-94b3-85fa340dc3ad with Priority: HIGHEST for action port [ 851.491688] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 with Priority: HIGHEST for action security_group_rules [ 851.492407] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 with Priority: HIGHEST for action security_group_members [ 851.492579] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b6c7d7b-07d5-4e5c-94b3-85fa340dc3ad with Priority: HIGHEST for action port [ 851.493254] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76ce9371-2113-4da6-8d86-1fcee6902f41 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.493381] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.493463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.493824] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.493910] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76ce9371-2113-4da6-8d86-1fcee6902f41',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.497942] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ce9371-2113-4da6-8d86-1fcee6902f41 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.498158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.498158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.499110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.499293] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.499405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.499484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.500267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.500365] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.500467] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76ce9371-2113-4da6-8d86-1fcee6902f41',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.503569] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b6c7d7b-07d5-4e5c-94b3-85fa340dc3ad taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.503569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b6c7d7b-07d5-4e5c-94b3-85fa340dc3ad" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.503569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b6c7d7b-07d5-4e5c-94b3-85fa340dc3ad" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.503826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b6c7d7b-07d5-4e5c-94b3-85fa340dc3ad" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.503826] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b6c7d7b-07d5-4e5c-94b3-85fa340dc3ad',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.996887] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ce9371-2113-4da6-8d86-1fcee6902f41 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.997932] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.007917] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('76ce9371-2113-4da6-8d86-1fcee6902f41',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.007917] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b6c7d7b-07d5-4e5c-94b3-85fa340dc3ad with status ACTIVE [ 852.007917] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.007917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.007917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.007917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.007917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.007917] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.007917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.007917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.007917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.007917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.007917] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.007917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.008608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.008866] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.009092] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.009376] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b6c7d7b-07d5-4e5c-94b3-85fa340dc3ad is going to be updated. [ 852.035806] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.035806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.035806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.035806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.035806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.035806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b6c7d7b-07d5-4e5c-94b3-85fa340dc3ad" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.511370] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('76ce9371-2113-4da6-8d86-1fcee6902f41',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.698036] env[66519]: INFO networking_nsxv3.common.synchronization [req-15a757ab-a4a2-442b-80b7-f71ff7a58803 req-460bb549-c35a-43c6-b50e-48cf2fd2ae3e tempest-ServerRescueTestJSON-1068866122 tempest-ServerRescueTestJSON-1068866122-project-member] Enqueued Resource ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 with Priority: HIGHEST for action security_group_members [ 852.699082] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 with Priority: HIGHEST for action security_group_members [ 852.699082] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.699082] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.699082] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.699353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.700027] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.700027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.700027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.700027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.700271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.700271] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.951997] env[66519]: INFO networking_nsxv3.common.synchronization [None req-7963995e-feec-43a1-a7a5-52ca69379961 None None] Enqueued Resource ID: a829f09e-f998-485d-a742-e4bf26076d8f with Priority: HIGHEST for action port [ 852.952567] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a829f09e-f998-485d-a742-e4bf26076d8f with Priority: HIGHEST for action port [ 852.952874] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-a829f09e-f998-485d-a742-e4bf26076d8f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.952987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a829f09e-f998-485d-a742-e4bf26076d8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.954036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a829f09e-f998-485d-a742-e4bf26076d8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.954291] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a829f09e-f998-485d-a742-e4bf26076d8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.954427] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a829f09e-f998-485d-a742-e4bf26076d8f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.015045] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.015045] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.015045] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.015045] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.015677] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.015677] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 is going to be created. [ 853.040509] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.040678] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.040758] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.041021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.041224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.053213] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 in Status: UNINITIALIZED for 2s [ 853.205580] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.205580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.205580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.205580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.205580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.205580] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.205580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.205580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.205580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.206065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.206065] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 already deleted. [ 853.206065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.387339] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.387622] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-11" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.388008] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-11" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.388331] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-11" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.388647] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.388840] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.389510] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.389510] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.389510] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.389795] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 853.389927] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 853.390013] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 853.390119] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 853.390328] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 853.390328] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 853.390452] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 853.411923] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 853.411923] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 853.411923] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 853.413313] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-11" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.413678] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-49ec6a21-6dba-402b-b58a-52f97ae7ec88 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.413862] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-49ec6a21-6dba-402b-b58a-52f97ae7ec88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.413982] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-49ec6a21-6dba-402b-b58a-52f97ae7ec88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.414501] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-49ec6a21-6dba-402b-b58a-52f97ae7ec88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.414654] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49ec6a21-6dba-402b-b58a-52f97ae7ec88',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.458426] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a829f09e-f998-485d-a742-e4bf26076d8f [ 853.458426] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.458426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.458426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.458426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.458426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.458426] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a829f09e-f998-485d-a742-e4bf26076d8f already deleted. [ 853.458426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a829f09e-f998-485d-a742-e4bf26076d8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.917448] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.917718] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.917846] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.918636] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.918812] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.918963] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 49ec6a21-6dba-402b-b58a-52f97ae7ec88 not found, creating... [ 853.919284] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.919541] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.919676] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.919910] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.920071] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.920383] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.920546] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.920663] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.920898] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.921036] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.921177] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 49ec6a21-6dba-402b-b58a-52f97ae7ec88 is going to be created. [ 853.942438] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.942662] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.942787] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.943114] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.943345] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.943576] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-49ec6a21-6dba-402b-b58a-52f97ae7ec88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.695000] env[66519]: INFO networking_nsxv3.common.synchronization [req-15a757ab-a4a2-442b-80b7-f71ff7a58803 req-1e892320-ff98-49d1-9203-1150239d0a4a service nova] Enqueued Resource ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 with Priority: HIGHEST for action security_group_rules [ 854.695686] env[66519]: INFO networking_nsxv3.common.synchronization [req-15a757ab-a4a2-442b-80b7-f71ff7a58803 req-1e892320-ff98-49d1-9203-1150239d0a4a service nova] Enqueued Resource ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 with Priority: HIGHEST for action security_group_members [ 854.695686] env[66519]: INFO networking_nsxv3.common.synchronization [req-15a757ab-a4a2-442b-80b7-f71ff7a58803 req-1e892320-ff98-49d1-9203-1150239d0a4a service nova] Enqueued Resource ID: 49ec6a21-6dba-402b-b58a-52f97ae7ec88 with Priority: HIGHEST for action port [ 854.695861] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 with Priority: HIGHEST for action security_group_rules [ 854.695970] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 with Priority: HIGHEST for action security_group_members [ 854.696151] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49ec6a21-6dba-402b-b58a-52f97ae7ec88 with Priority: HIGHEST for action port [ 854.696809] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.698160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.698267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.698462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.698570] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.699548] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.699695] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.699771] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.700457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.700457] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.700457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.700457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.700457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.700752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.700752] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.704172] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-49ec6a21-6dba-402b-b58a-52f97ae7ec88 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.704172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49ec6a21-6dba-402b-b58a-52f97ae7ec88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.704172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49ec6a21-6dba-402b-b58a-52f97ae7ec88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.704172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49ec6a21-6dba-402b-b58a-52f97ae7ec88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.705478] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49ec6a21-6dba-402b-b58a-52f97ae7ec88',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.065250] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 in Status: SUCCESS [ 855.065250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.065250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.065250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.065250] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.065250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.065250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.065682] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.065682] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.065682] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.065682] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('76ce9371-2113-4da6-8d86-1fcee6902f41',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.163045] env[66519]: INFO networking_nsxv3.common.synchronization [None req-d5b95d38-0c37-4841-96be-6efa865a3c9b None None] Enqueued Resource ID: 4a4091ba-0570-4c56-ac9a-09ea66d6ce5b with Priority: HIGHEST for action port [ 855.165175] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a4091ba-0570-4c56-ac9a-09ea66d6ce5b with Priority: HIGHEST for action port [ 855.165175] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a4091ba-0570-4c56-ac9a-09ea66d6ce5b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.165175] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a4091ba-0570-4c56-ac9a-09ea66d6ce5b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.165175] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a4091ba-0570-4c56-ac9a-09ea66d6ce5b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.165175] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a4091ba-0570-4c56-ac9a-09ea66d6ce5b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.165175] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a4091ba-0570-4c56-ac9a-09ea66d6ce5b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.206327] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.208568] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.208568] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.209496] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49ec6a21-6dba-402b-b58a-52f97ae7ec88 with status ACTIVE [ 855.209778] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.209778] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.209778] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.210030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.210238] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.210303] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.210371] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.210442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.210653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.210716] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.212341] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.212341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.212341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.212341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.212341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.212341] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49ec6a21-6dba-402b-b58a-52f97ae7ec88 is going to be updated. [ 855.227034] env[66519]: INFO networking_nsxv3.common.synchronization [None req-dbd98ec3-5dfd-46c5-894d-9e1872b9fdf2 None None] Enqueued Resource ID: d4c7c9bd-a705-4b47-adcd-ec62618c1bb3 with Priority: HIGHEST for action port [ 855.227427] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4c7c9bd-a705-4b47-adcd-ec62618c1bb3 with Priority: HIGHEST for action port [ 855.228601] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4c7c9bd-a705-4b47-adcd-ec62618c1bb3 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.228740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4c7c9bd-a705-4b47-adcd-ec62618c1bb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.228826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4c7c9bd-a705-4b47-adcd-ec62618c1bb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.229105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4c7c9bd-a705-4b47-adcd-ec62618c1bb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.229181] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4c7c9bd-a705-4b47-adcd-ec62618c1bb3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.239608] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.239766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.239766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.240051] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.240140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.240260] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49ec6a21-6dba-402b-b58a-52f97ae7ec88" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.253386] env[66519]: INFO networking_nsxv3.common.synchronization [req-7ba00fed-f646-46f8-8471-0937991b1380 req-ba18158f-28e1-42d4-9bba-e13c79b1da0f tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 with Priority: HIGHEST for action security_group_members [ 855.253386] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 with Priority: HIGHEST for action security_group_members [ 855.253386] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.253386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.253386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.254551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.254668] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.254796] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.254848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.255362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.255362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.255362] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c204b4b3-a1d5-4736-9d79-b4de3adce0c8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.571235] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ce9371-2113-4da6-8d86-1fcee6902f41 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.571235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.571235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.571235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.571235] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.571235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.571235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.571235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.571235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.571235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.571235] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ce9371-2113-4da6-8d86-1fcee6902f41 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.571235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.571235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.571235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.571235] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.571235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.571834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.571834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.571834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.571834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.571834] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('76ce9371-2113-4da6-8d86-1fcee6902f41',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.672133] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a4091ba-0570-4c56-ac9a-09ea66d6ce5b [ 855.672133] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.672133] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.672133] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.672133] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.672433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.672433] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a4091ba-0570-4c56-ac9a-09ea66d6ce5b already deleted. [ 855.672433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a4091ba-0570-4c56-ac9a-09ea66d6ce5b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.678671] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.678921] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.679064] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.680051] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.680375] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.680567] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.680688] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.680945] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.681098] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.681299] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.681402] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 855.681500] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 855.681597] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 855.681703] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.682647] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 855.682647] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 855.705842] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 855.706207] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 855.706419] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 855.706629] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.706959] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-419d20b6-87a2-4ef4-aa00-8cc1929bb250 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.709022] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-419d20b6-87a2-4ef4-aa00-8cc1929bb250" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.709022] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-419d20b6-87a2-4ef4-aa00-8cc1929bb250" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.709022] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-419d20b6-87a2-4ef4-aa00-8cc1929bb250" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.709022] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('419d20b6-87a2-4ef4-aa00-8cc1929bb250',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.710493] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.731961] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4c7c9bd-a705-4b47-adcd-ec62618c1bb3 [ 855.731961] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.731961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.731961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.737215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.737215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.737215] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4c7c9bd-a705-4b47-adcd-ec62618c1bb3 already deleted. [ 855.737215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4c7c9bd-a705-4b47-adcd-ec62618c1bb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.758747] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.758962] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.759258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.759258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.759406] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.759640] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.759760] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.759843] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.760048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.760181] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.760235] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 already deleted. [ 855.760295] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.076589] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 76ce9371-2113-4da6-8d86-1fcee6902f41: rpc.has_security_group_logging(os_id): False [ 856.097615] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.097828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.097898] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.098170] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.098431] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.098568] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.098874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.098874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.098977] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.099060] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.103021] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.103021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.103021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.103021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.103021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.103021] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.103021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.103021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.103021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.103021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.103021] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 is going to be created. [ 856.167027] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.167027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.167027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.167027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.167027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.180921] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 in Status: IN_PROGRESS for 2s [ 856.210893] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.211260] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.211439] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.211754] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.211988] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.212225] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 419d20b6-87a2-4ef4-aa00-8cc1929bb250 not found, creating... [ 856.212642] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.212896] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.213108] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.213433] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.213666] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.214113] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.214366] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.214466] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.214717] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.215018] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.215018] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 419d20b6-87a2-4ef4-aa00-8cc1929bb250 is going to be created. [ 856.216304] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.216845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.216951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.217108] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.217189] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.217273] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 is going to be created. [ 856.239230] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.239417] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.239549] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.239817] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.240341] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.240341] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-419d20b6-87a2-4ef4-aa00-8cc1929bb250" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.242448] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.242741] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.242741] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.242826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.242924] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.263513] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 in Status: UNINITIALIZED for 2s [ 856.979881] env[66519]: INFO networking_nsxv3.common.synchronization [req-7ba00fed-f646-46f8-8471-0937991b1380 req-a6cf718b-2a73-42fe-8914-9ad32768bc37 service nova] Enqueued Resource ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 with Priority: HIGHEST for action security_group_rules [ 856.980162] env[66519]: INFO networking_nsxv3.common.synchronization [req-7ba00fed-f646-46f8-8471-0937991b1380 req-a6cf718b-2a73-42fe-8914-9ad32768bc37 service nova] Enqueued Resource ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 with Priority: HIGHEST for action security_group_members [ 856.980202] env[66519]: INFO networking_nsxv3.common.synchronization [req-7ba00fed-f646-46f8-8471-0937991b1380 req-a6cf718b-2a73-42fe-8914-9ad32768bc37 service nova] Enqueued Resource ID: 419d20b6-87a2-4ef4-aa00-8cc1929bb250 with Priority: HIGHEST for action port [ 856.980805] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 with Priority: HIGHEST for action security_group_rules [ 856.980861] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 with Priority: HIGHEST for action security_group_members [ 856.980955] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 419d20b6-87a2-4ef4-aa00-8cc1929bb250 with Priority: HIGHEST for action port [ 856.981346] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.981552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.981552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.982515] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.982600] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c204b4b3-a1d5-4736-9d79-b4de3adce0c8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.983969] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.984140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.985563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.985783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.985946] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.986068] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.986267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.986323] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.986428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.986521] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c204b4b3-a1d5-4736-9d79-b4de3adce0c8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.992074] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-419d20b6-87a2-4ef4-aa00-8cc1929bb250 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.992186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-419d20b6-87a2-4ef4-aa00-8cc1929bb250" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.992252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-419d20b6-87a2-4ef4-aa00-8cc1929bb250" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.992415] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-419d20b6-87a2-4ef4-aa00-8cc1929bb250" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.992492] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('419d20b6-87a2-4ef4-aa00-8cc1929bb250',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.494686] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c204b4b3-a1d5-4736-9d79-b4de3adce0c8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.496961] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.496961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.496961] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 419d20b6-87a2-4ef4-aa00-8cc1929bb250 with status ACTIVE [ 857.496961] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.497608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.497608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.497608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.497608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.497930] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.498076] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.498124] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.498306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.498388] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.498575] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.498671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.498728] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.498874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.498979] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.499049] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 419d20b6-87a2-4ef4-aa00-8cc1929bb250 is going to be updated. [ 857.518836] env[66519]: INFO networking_nsxv3.common.synchronization [None req-63328730-bc7f-40d2-8e57-8fdbd89a3a04 tempest-ServerActionsTestOtherB-865317477 tempest-ServerActionsTestOtherB-865317477-project-member] Enqueued Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_rules [ 857.518836] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_rules [ 857.518836] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.519261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.519261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.519335] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.519373] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.525914] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.525914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.525914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.525914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.525914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.525914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-419d20b6-87a2-4ef4-aa00-8cc1929bb250" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.704673] env[66519]: INFO networking_nsxv3.common.synchronization [None req-13fba2ef-2d3e-41a4-8bae-887ed017d16d tempest-ServerActionsTestOtherB-865317477 tempest-ServerActionsTestOtherB-865317477-project-member] Enqueued Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_rules [ 857.705843] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_rules [ 857.705843] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.705843] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.996911] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c204b4b3-a1d5-4736-9d79-b4de3adce0c8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.042542] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.042758] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.042758] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.043024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.043024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.043119] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee already deleted. [ 858.043228] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.043318] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.043483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.043563] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.198624] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 in Status: SUCCESS [ 858.198624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.273079] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 in Status: SUCCESS [ 858.273308] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.273480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.273699] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.273893] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.274017] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.274081] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.274237] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.274317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.274405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.274494] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.467886] env[66519]: INFO networking_nsxv3.common.synchronization [None req-5a492169-c029-4d7e-99e4-c68851f0f76f None None] Enqueued Resource ID: b1a00562-230a-472d-80fb-0b7f81bd6ea6 with Priority: HIGHEST for action port [ 858.468381] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1a00562-230a-472d-80fb-0b7f81bd6ea6 with Priority: HIGHEST for action port [ 858.468838] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1a00562-230a-472d-80fb-0b7f81bd6ea6 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.468932] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1a00562-230a-472d-80fb-0b7f81bd6ea6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.468990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1a00562-230a-472d-80fb-0b7f81bd6ea6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.470337] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1a00562-230a-472d-80fb-0b7f81bd6ea6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.470337] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1a00562-230a-472d-80fb-0b7f81bd6ea6',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.499576] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.499753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.499834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.500109] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.500383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.500383] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 is going to be created. [ 858.527392] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.527870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.527990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.528248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.528445] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.538868] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 in Status: UNINITIALIZED for 2s [ 858.566225] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.566225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.566225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.566225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.566534] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.566534] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee already deleted. [ 858.566534] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.779398] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.779483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.779532] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.779743] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.779905] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.780016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.780105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.780373] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.780373] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.780373] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.780556] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.780677] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.780758] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.780882] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.781034] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.781128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.781186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.781321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.781392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.781470] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.781555] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.849049] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-947 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.849248] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-947" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.849403] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-947" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.849623] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-947" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.849873] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.850494] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.851037] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.851037] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.851159] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.851290] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 858.851398] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 858.851508] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 858.851704] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 858.851704] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 858.851822] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 858.851999] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 858.871340] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 858.871524] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 858.871617] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 858.871791] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-947" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.872267] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.872446] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.872559] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.872813] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.872940] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e0d6cd2-3221-4000-9d6c-112b9e9ede4a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.971928] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1a00562-230a-472d-80fb-0b7f81bd6ea6 [ 858.972074] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.972145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.972223] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.972425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.972521] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.972624] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1a00562-230a-472d-80fb-0b7f81bd6ea6 already deleted. [ 858.972707] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1a00562-230a-472d-80fb-0b7f81bd6ea6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.284094] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9: rpc.has_security_group_logging(os_id): False [ 859.375635] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.376094] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.376371] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.376938] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.377233] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.377710] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.378024] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.378266] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.378678] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.378945] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.379407] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.379745] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.379987] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.380431] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.380718] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.380981] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 5e0d6cd2-3221-4000-9d6c-112b9e9ede4a is going to be updated. [ 859.406294] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.406506] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.406574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.406796] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.406887] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.407125] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.407229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.407299] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.407481] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.407603] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.407826] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.407926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.407988] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.408148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.408221] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.408405] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.408500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.408554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.408692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.408763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.408864] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 is going to be created. [ 859.418694] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.419404] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.419559] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.419787] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.420103] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.420224] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.476722] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.476722] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.476722] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.476722] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.476722] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.489652] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 in Status: IN_PROGRESS for 2s [ 860.112168] env[66519]: INFO networking_nsxv3.common.synchronization [req-75ba9ac4-bdcd-433c-b51b-09e32b075f5d req-a772bafe-1684-45c4-a3a3-0dfc5cf13212 service nova] Enqueued Resource ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 with Priority: HIGHEST for action security_group_rules [ 860.112168] env[66519]: INFO networking_nsxv3.common.synchronization [req-75ba9ac4-bdcd-433c-b51b-09e32b075f5d req-a772bafe-1684-45c4-a3a3-0dfc5cf13212 service nova] Enqueued Resource ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 with Priority: HIGHEST for action security_group_members [ 860.112168] env[66519]: INFO networking_nsxv3.common.synchronization [req-75ba9ac4-bdcd-433c-b51b-09e32b075f5d req-a772bafe-1684-45c4-a3a3-0dfc5cf13212 service nova] Enqueued Resource ID: 5e0d6cd2-3221-4000-9d6c-112b9e9ede4a with Priority: HIGHEST for action port [ 860.112709] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 with Priority: HIGHEST for action security_group_rules [ 860.112867] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 with Priority: HIGHEST for action security_group_members [ 860.113051] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e0d6cd2-3221-4000-9d6c-112b9e9ede4a with Priority: HIGHEST for action port [ 860.117431] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.117523] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.117578] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.117793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.117881] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb3bbf89-6cbf-4b9e-b793-607035a2d9c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.119787] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.119787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.119787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.119965] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.120081] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.120505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.120577] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.120820] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.120820] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.120909] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb3bbf89-6cbf-4b9e-b793-607035a2d9c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.122851] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.122964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.123047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.123209] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.123296] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e0d6cd2-3221-4000-9d6c-112b9e9ede4a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.551644] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 in Status: SUCCESS [ 860.551644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.551644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.551644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.551644] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.551644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.551644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.551644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.551644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.551644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.551644] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c204b4b3-a1d5-4736-9d79-b4de3adce0c8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.623409] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb3bbf89-6cbf-4b9e-b793-607035a2d9c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.625214] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.625372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.626743] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e0d6cd2-3221-4000-9d6c-112b9e9ede4a with status ACTIVE [ 860.626977] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.627140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.627221] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.627554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.627647] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.627764] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.627866] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.627922] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.628142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.628204] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.628354] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.628473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.628519] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.628640] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.628724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.628827] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e0d6cd2-3221-4000-9d6c-112b9e9ede4a is going to be updated. [ 860.658846] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.659076] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.659076] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.659299] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.659442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.659765] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e0d6cd2-3221-4000-9d6c-112b9e9ede4a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.055245] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c204b4b3-a1d5-4736-9d79-b4de3adce0c8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.132402] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb3bbf89-6cbf-4b9e-b793-607035a2d9c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.505635] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 in Status: SUCCESS [ 861.505635] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.557920] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c204b4b3-a1d5-4736-9d79-b4de3adce0c8: rpc.has_security_group_logging(os_id): False [ 861.585326] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.585524] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.585524] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.586184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.586184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.586400] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.587452] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.587452] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.587452] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.587662] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.588770] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 is going to be created. [ 861.634689] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.634689] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.634689] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.634689] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.635155] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.635155] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 is going to be updated. [ 861.661688] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.661946] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.662034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.662279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.662529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.670322] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.670748] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.670851] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.671490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.671490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.678720] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 in Status: IN_PROGRESS for 2s [ 861.681180] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 in Status: IN_PROGRESS for 2s [ 863.695664] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 in Status: SUCCESS [ 863.695664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.695664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.695664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.695664] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.695664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.695664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.695664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.695664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.695664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.695664] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb3bbf89-6cbf-4b9e-b793-607035a2d9c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.697457] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 in Status: SUCCESS [ 863.697706] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.200951] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb3bbf89-6cbf-4b9e-b793-607035a2d9c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.287131] env[66519]: INFO networking_nsxv3.common.synchronization [None req-f5cacd61-2cf7-4e21-822d-03fafcbfde41 None None] Enqueued Resource ID: 32d8744d-5982-4d58-97dc-e418aef66c18 with Priority: HIGHEST for action port [ 864.288663] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d8744d-5982-4d58-97dc-e418aef66c18 with Priority: HIGHEST for action port [ 864.289165] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-32d8744d-5982-4d58-97dc-e418aef66c18 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.289875] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32d8744d-5982-4d58-97dc-e418aef66c18" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.289875] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32d8744d-5982-4d58-97dc-e418aef66c18" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.289875] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32d8744d-5982-4d58-97dc-e418aef66c18" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.289875] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32d8744d-5982-4d58-97dc-e418aef66c18',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.704131] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb3bbf89-6cbf-4b9e-b793-607035a2d9c3: rpc.has_security_group_logging(os_id): False [ 864.728842] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.729063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.729175] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.729342] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.751448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.751755] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.751913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.751982] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.752213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.752315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.752406] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 is going to be updated. [ 864.792574] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32d8744d-5982-4d58-97dc-e418aef66c18 [ 864.792858] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.793064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.793182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.793877] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.793877] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.793877] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32d8744d-5982-4d58-97dc-e418aef66c18 already deleted. [ 864.793877] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32d8744d-5982-4d58-97dc-e418aef66c18" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.808805] env[66519]: INFO networking_nsxv3.common.synchronization [req-76b8b55f-dd03-4f1f-87bb-68fab4c43b7e req-7dce44d1-3691-4e8b-b4c6-087666300bad tempest-ServerPasswordTestJSON-210038778 tempest-ServerPasswordTestJSON-210038778-project-member] Enqueued Resource ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 with Priority: HIGHEST for action security_group_members [ 864.810081] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 with Priority: HIGHEST for action security_group_members [ 864.810428] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ff4300a-fb40-480e-bce1-da4cdaede807 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.810557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.810631] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.810882] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.811049] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.811167] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.811210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.811361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.811444] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.811538] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ff4300a-fb40-480e-bce1-da4cdaede807',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.824289] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.824563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.824563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.825222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.825222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.844296] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 in Status: IN_PROGRESS for 2s [ 865.318858] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.318858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.318858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.318858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.318858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.319293] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.319293] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.319293] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.319293] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.319486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.319486] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 already deleted. [ 865.319486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.394563] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-485 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.394563] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-485" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.394563] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-485" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.394563] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-485" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.394884] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.394884] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.425817] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.425817] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.425817] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.425817] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.425817] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.425817] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.425817] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.425817] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.425817] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.425817] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.425817] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.425817] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 865.425817] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.425817] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-485" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.425817] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-1e382b3b-8836-4342-ae45-4177e7133039 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.425817] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-1e382b3b-8836-4342-ae45-4177e7133039" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.425817] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-1e382b3b-8836-4342-ae45-4177e7133039" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.425817] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-1e382b3b-8836-4342-ae45-4177e7133039" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.426525] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e382b3b-8836-4342-ae45-4177e7133039',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.632106] env[66519]: INFO networking_nsxv3.common.synchronization [req-fa2c42d1-5635-4381-9995-fcffc709692d req-93a8f788-087b-4ee9-a269-cabd78457850 tempest-ImagesTestJSON-1420515381 tempest-ImagesTestJSON-1420515381-project-member] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 865.632952] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 865.633412] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.633580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.633682] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.634461] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.634461] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.634461] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.634687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.634823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.635044] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.635044] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.925554] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.926274] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.926274] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.926498] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.927661] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.927661] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 1e382b3b-8836-4342-ae45-4177e7133039 not found, creating... [ 865.927661] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.927661] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.927661] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.928217] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.928628] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.929041] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.929279] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.929551] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.930146] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.930146] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.930989] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 1e382b3b-8836-4342-ae45-4177e7133039 is going to be created. [ 865.953626] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.953626] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.953626] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.953962] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.954532] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.954532] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-1e382b3b-8836-4342-ae45-4177e7133039" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.138994] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.138994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.138994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.138994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.139273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.139387] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.139529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.139598] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.139829] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.139917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.141685] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be updated. [ 866.179172] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.179270] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.179394] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.179737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.179962] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.192101] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: IN_PROGRESS for 2s [ 866.203653] env[66519]: INFO networking_nsxv3.common.synchronization [req-ed8c05b7-7b00-4034-b368-79fdadba5e84 req-decc2884-21a8-4fca-8cfe-b22faa833aef tempest-FloatingIPsAssociationTestJSON-1821391314 tempest-FloatingIPsAssociationTestJSON-1821391314-project-member] Enqueued Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGHEST for action security_group_members [ 866.204607] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGHEST for action security_group_members [ 866.205142] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.205340] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.205458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.205773] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.206036] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.206215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.206335] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.206625] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.206773] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.206922] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.709447] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.724367] env[66519]: INFO networking_nsxv3.common.synchronization [req-76b8b55f-dd03-4f1f-87bb-68fab4c43b7e req-5d274902-0954-450f-b4e7-ccd8c65238ec service nova] Enqueued Resource ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 with Priority: HIGHEST for action security_group_rules [ 866.724573] env[66519]: INFO networking_nsxv3.common.synchronization [req-76b8b55f-dd03-4f1f-87bb-68fab4c43b7e req-5d274902-0954-450f-b4e7-ccd8c65238ec service nova] Enqueued Resource ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 with Priority: HIGHEST for action security_group_members [ 866.724723] env[66519]: INFO networking_nsxv3.common.synchronization [req-76b8b55f-dd03-4f1f-87bb-68fab4c43b7e req-5d274902-0954-450f-b4e7-ccd8c65238ec service nova] Enqueued Resource ID: 1e382b3b-8836-4342-ae45-4177e7133039 with Priority: HIGHEST for action port [ 866.725551] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 with Priority: HIGHEST for action security_group_rules [ 866.725890] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 with Priority: HIGHEST for action security_group_members [ 866.725890] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e382b3b-8836-4342-ae45-4177e7133039 with Priority: HIGHEST for action port [ 866.726119] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ff4300a-fb40-480e-bce1-da4cdaede807 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.726233] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.726587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.726683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.726712] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ff4300a-fb40-480e-bce1-da4cdaede807',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.727790] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ff4300a-fb40-480e-bce1-da4cdaede807 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.728199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.728199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.728279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.728597] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.728597] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.728597] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.728735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.728735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.728975] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ff4300a-fb40-480e-bce1-da4cdaede807',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.729858] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e382b3b-8836-4342-ae45-4177e7133039 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.729858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e382b3b-8836-4342-ae45-4177e7133039" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.729858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e382b3b-8836-4342-ae45-4177e7133039" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.730037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e382b3b-8836-4342-ae45-4177e7133039" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.730064] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e382b3b-8836-4342-ae45-4177e7133039',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.865964] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 in Status: SUCCESS [ 866.866118] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.212608] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.232234] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ff4300a-fb40-480e-bce1-da4cdaede807',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.233563] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ff4300a-fb40-480e-bce1-da4cdaede807 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.234468] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.236107] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e382b3b-8836-4342-ae45-4177e7133039 with status ACTIVE [ 867.236107] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.236107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.236107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.236107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.236107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.236107] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.236107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.236107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.236107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.236107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.245024] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.245024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.245024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.245024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.245024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.245024] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e382b3b-8836-4342-ae45-4177e7133039 is going to be updated. [ 867.268269] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.268529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.268529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.268699] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.268904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.269118] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e382b3b-8836-4342-ae45-4177e7133039" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.433117] env[66519]: INFO networking_nsxv3.common.synchronization [req-118c4c44-5b5e-4a28-afd2-d77d77ad328d req-6a119519-8765-447c-85f8-6f458e89d2f4 tempest-ServersTestJSON-971253557 tempest-ServersTestJSON-971253557-project-member] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 867.433479] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 867.434336] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.434431] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.434431] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.434675] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.435757] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.435911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.436096] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.436260] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.436411] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.436637] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.556022] env[66519]: INFO networking_nsxv3.common.synchronization [None req-a545bbeb-a4e4-4f0b-952f-08f968b09044 None None] Enqueued Resource ID: bccd6da6-4148-496a-9c4e-f1a00f41695c with Priority: HIGHEST for action port [ 867.556022] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bccd6da6-4148-496a-9c4e-f1a00f41695c with Priority: HIGHEST for action port [ 867.556022] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-bccd6da6-4148-496a-9c4e-f1a00f41695c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.556022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bccd6da6-4148-496a-9c4e-f1a00f41695c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.556022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bccd6da6-4148-496a-9c4e-f1a00f41695c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.558214] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bccd6da6-4148-496a-9c4e-f1a00f41695c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.558214] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bccd6da6-4148-496a-9c4e-f1a00f41695c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.716475] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.716475] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.716475] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.716475] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.716475] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.716475] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34191aa8-8997-42e0-88cc-151380dc439e is going to be updated. [ 867.746325] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ff4300a-fb40-480e-bce1-da4cdaede807',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.760761] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.762634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.762634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.762634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.762634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.776190] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34191aa8-8997-42e0-88cc-151380dc439e in Status: IN_PROGRESS for 2s [ 867.891630] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-450 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.891835] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.891954] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.892253] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.892491] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.892641] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.892754] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.892962] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.893113] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.893316] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.893426] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.893530] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.893636] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.893740] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.893841] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.893967] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.916760] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.916934] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 867.917344] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.917616] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.917756] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-82e139dd-0b3d-42a0-8fd5-51b06f8d4390 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.917925] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-82e139dd-0b3d-42a0-8fd5-51b06f8d4390" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.918708] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-82e139dd-0b3d-42a0-8fd5-51b06f8d4390" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.918708] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-82e139dd-0b3d-42a0-8fd5-51b06f8d4390" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.918708] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82e139dd-0b3d-42a0-8fd5-51b06f8d4390',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.939283] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.059635] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bccd6da6-4148-496a-9c4e-f1a00f41695c [ 868.059870] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.060015] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.060094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.060309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.060394] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.060489] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bccd6da6-4148-496a-9c4e-f1a00f41695c already deleted. [ 868.060571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bccd6da6-4148-496a-9c4e-f1a00f41695c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.205611] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: IN_PROGRESS for 4s [ 868.247846] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.248240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.248240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.248529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.248669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.248819] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 is going to be created. [ 868.278621] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.278621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.278837] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.280129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.280129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.298362] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 in Status: UNINITIALIZED for 2s [ 868.420888] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.421196] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.421328] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.421609] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.421819] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.421979] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 82e139dd-0b3d-42a0-8fd5-51b06f8d4390 not found, creating... [ 868.422369] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.422604] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.422742] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.422982] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.423132] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.423915] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.424294] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.424540] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.424853] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.425209] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.425400] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 82e139dd-0b3d-42a0-8fd5-51b06f8d4390 is going to be created. [ 868.442258] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.450425] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.450672] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.450796] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.451136] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.451357] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.451578] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-82e139dd-0b3d-42a0-8fd5-51b06f8d4390" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.944567] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.945449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.945545] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.945767] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.945891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.947332] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 868.955771] env[66519]: INFO networking_nsxv3.common.synchronization [None req-8a77ee54-dad4-4443-8038-48688e16baea None None] Enqueued Resource ID: 4de3f9f3-caf8-457e-ac14-546b6274f3f0 with Priority: HIGHEST for action port [ 868.957663] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4de3f9f3-caf8-457e-ac14-546b6274f3f0 with Priority: HIGHEST for action port [ 868.957663] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-4de3f9f3-caf8-457e-ac14-546b6274f3f0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.957663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4de3f9f3-caf8-457e-ac14-546b6274f3f0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.957663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4de3f9f3-caf8-457e-ac14-546b6274f3f0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.957663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4de3f9f3-caf8-457e-ac14-546b6274f3f0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.957663] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4de3f9f3-caf8-457e-ac14-546b6274f3f0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.982187] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.983263] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.983263] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.983263] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.983263] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.998030] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 869.233031] env[66519]: INFO networking_nsxv3.common.synchronization [req-118c4c44-5b5e-4a28-afd2-d77d77ad328d req-2ecfbbfc-c4ef-41f7-acd4-93a074e3a789 service nova] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_rules [ 869.233031] env[66519]: INFO networking_nsxv3.common.synchronization [req-118c4c44-5b5e-4a28-afd2-d77d77ad328d req-2ecfbbfc-c4ef-41f7-acd4-93a074e3a789 service nova] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 869.233031] env[66519]: INFO networking_nsxv3.common.synchronization [req-118c4c44-5b5e-4a28-afd2-d77d77ad328d req-2ecfbbfc-c4ef-41f7-acd4-93a074e3a789 service nova] Enqueued Resource ID: 82e139dd-0b3d-42a0-8fd5-51b06f8d4390 with Priority: HIGHEST for action port [ 869.233031] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_rules [ 869.233031] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 869.233031] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e139dd-0b3d-42a0-8fd5-51b06f8d4390 with Priority: HIGHEST for action port [ 869.233455] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.233455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.233455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.233670] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.233670] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.234958] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.235111] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.235345] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-82e139dd-0b3d-42a0-8fd5-51b06f8d4390 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.235716] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82e139dd-0b3d-42a0-8fd5-51b06f8d4390" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.235716] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82e139dd-0b3d-42a0-8fd5-51b06f8d4390" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.235716] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82e139dd-0b3d-42a0-8fd5-51b06f8d4390" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.235992] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82e139dd-0b3d-42a0-8fd5-51b06f8d4390',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.460404] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4de3f9f3-caf8-457e-ac14-546b6274f3f0 [ 869.460672] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.460793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.460856] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.461116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.461213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.461314] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4de3f9f3-caf8-457e-ac14-546b6274f3f0 already deleted. [ 869.461394] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4de3f9f3-caf8-457e-ac14-546b6274f3f0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.739049] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.739252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.739542] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82e139dd-0b3d-42a0-8fd5-51b06f8d4390 with status ACTIVE [ 869.739736] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.739840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.739910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.740206] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.740291] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.740462] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.740621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.740715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.740898] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.740999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.741245] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.741340] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.741734] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.741734] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.741830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.741856] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82e139dd-0b3d-42a0-8fd5-51b06f8d4390 is going to be updated. [ 869.771529] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.771529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.771905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.772143] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.772295] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.772474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82e139dd-0b3d-42a0-8fd5-51b06f8d4390" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.789686] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34191aa8-8997-42e0-88cc-151380dc439e in Status: SUCCESS [ 869.789957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.216338] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: SUCCESS [ 870.216599] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 deletion is rescheduled due to dependency. [ 870.216726] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.309666] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 in Status: SUCCESS [ 870.309945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.310192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.310484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.310959] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.310959] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.311172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.311271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.311386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.311516] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.311645] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ff4300a-fb40-480e-bce1-da4cdaede807',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.460992] env[66519]: INFO networking_nsxv3.common.synchronization [None req-3782f9d5-3cc6-4a8a-b0d3-e3f48cdc9ab5 tempest-ServersTestJSON-1970727514 tempest-ServersTestJSON-1970727514-project-member] Enqueued Resource ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 with Priority: HIGHEST for action security_group_rules [ 870.461463] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 with Priority: HIGHEST for action security_group_rules [ 870.461801] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.461934] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.462041] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.462286] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.462369] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.567644] env[66519]: INFO networking_nsxv3.common.synchronization [None req-2a9e8c07-76d9-487a-9a87-f6a8dd540a6e tempest-ServersTestJSON-1970727514 tempest-ServersTestJSON-1970727514-project-member] Enqueued Resource ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 with Priority: HIGHEST for action security_group_rules [ 870.568882] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 with Priority: HIGHEST for action security_group_rules [ 870.570150] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.570150] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.814915] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ff4300a-fb40-480e-bce1-da4cdaede807 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.815103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.815178] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.815397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.815567] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.815666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.815730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.815877] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.815965] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.816177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.816337] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ff4300a-fb40-480e-bce1-da4cdaede807 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.816430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.816552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.816725] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.816894] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.816989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.817063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.817203] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.817279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.817362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.817485] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ff4300a-fb40-480e-bce1-da4cdaede807',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.875173] env[66519]: INFO networking_nsxv3.common.synchronization [None req-efa83eba-56ff-465d-987e-75ff6d729bd0 None None] Enqueued Resource ID: 3cf5fca9-c91e-4c83-9085-a82f834037aa with Priority: HIGHEST for action port [ 870.876089] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cf5fca9-c91e-4c83-9085-a82f834037aa with Priority: HIGHEST for action port [ 870.876328] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cf5fca9-c91e-4c83-9085-a82f834037aa taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.876448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cf5fca9-c91e-4c83-9085-a82f834037aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.876553] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cf5fca9-c91e-4c83-9085-a82f834037aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.876794] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cf5fca9-c91e-4c83-9085-a82f834037aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.876880] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cf5fca9-c91e-4c83-9085-a82f834037aa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.983044] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.983274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.983274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.984210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.984210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.984210] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 already deleted. [ 870.984210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.984210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.984210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.984210] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.013032] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 871.013338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.013503] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.013717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.013912] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.014037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.014100] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.014250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.014326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.014416] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.319656] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ff4300a-fb40-480e-bce1-da4cdaede807: rpc.has_security_group_logging(os_id): False [ 871.339963] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.339963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.339963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.339963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.339963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.339963] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.339963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.339963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.339963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.339963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.340428] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.340428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.340428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.340428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.340428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.340562] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.340637] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.340705] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.340819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.340886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.340966] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 is going to be created. [ 871.379387] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cf5fca9-c91e-4c83-9085-a82f834037aa [ 871.379584] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.379688] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.379751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.379982] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.380147] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.380358] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cf5fca9-c91e-4c83-9085-a82f834037aa already deleted. [ 871.380358] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cf5fca9-c91e-4c83-9085-a82f834037aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.410949] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.411222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.411464] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.411577] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.411751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.428497] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 in Status: IN_PROGRESS for 2s [ 871.509891] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.510287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.510391] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.510725] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.513258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.513258] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 already deleted. [ 871.513258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.517767] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.021563] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.261552] env[66519]: INFO networking_nsxv3.common.synchronization [req-4444edcf-640f-4535-aabd-084843e5eeb3 req-37af13fb-59c3-4476-ae98-1f997f7f060b tempest-SecurityGroupRulesNegativeTestJSON-2133868576 tempest-SecurityGroupRulesNegativeTestJSON-2133868576-project-member] Enqueued Resource ID: d30b368c-7bbb-4693-ad93-ae14a6dec4d1 with Priority: HIGHEST for action security_group_rules [ 872.261552] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d30b368c-7bbb-4693-ad93-ae14a6dec4d1 with Priority: HIGHEST for action security_group_rules [ 872.261552] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d30b368c-7bbb-4693-ad93-ae14a6dec4d1 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.262157] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d30b368c-7bbb-4693-ad93-ae14a6dec4d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.262248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d30b368c-7bbb-4693-ad93-ae14a6dec4d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.262621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d30b368c-7bbb-4693-ad93-ae14a6dec4d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.262621] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d30b368c-7bbb-4693-ad93-ae14a6dec4d1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.526784] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.527301] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.527301] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.527670] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.527991] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.527991] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 872.574654] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.574903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.574984] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.575286] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.575409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.589373] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 872.788062] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.788062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.788062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.788062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.788062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.788062] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d30b368c-7bbb-4693-ad93-ae14a6dec4d1 already deleted. [ 872.788062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d30b368c-7bbb-4693-ad93-ae14a6dec4d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.449669] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 in Status: SUCCESS [ 873.450041] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.169199] env[66519]: INFO networking_nsxv3.common.synchronization [req-79f775db-d9d6-47e6-bb58-db285c1138c6 req-b04f51d2-4b2b-4336-8784-9ee431a12844 tempest-SecurityGroupRulesNegativeTestJSON-2133868576 tempest-SecurityGroupRulesNegativeTestJSON-2133868576-project-member] Enqueued Resource ID: d30b368c-7bbb-4693-ad93-ae14a6dec4d1 with Priority: HIGHEST for action security_group_rules [ 874.169199] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d30b368c-7bbb-4693-ad93-ae14a6dec4d1 with Priority: HIGHEST for action security_group_rules [ 874.170514] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d30b368c-7bbb-4693-ad93-ae14a6dec4d1 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.170514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d30b368c-7bbb-4693-ad93-ae14a6dec4d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.170514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d30b368c-7bbb-4693-ad93-ae14a6dec4d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.170514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d30b368c-7bbb-4693-ad93-ae14a6dec4d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.170514] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d30b368c-7bbb-4693-ad93-ae14a6dec4d1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.601232] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 874.601232] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.601232] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.601232] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.601232] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.601535] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.601535] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.601713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.602033] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.602033] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.602033] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.696278] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.696428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.696520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.696735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.696849] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.696954] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d30b368c-7bbb-4693-ad93-ae14a6dec4d1 already deleted. [ 874.697082] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d30b368c-7bbb-4693-ad93-ae14a6dec4d1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.106663] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.106827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.106895] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.107314] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.107314] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.107916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.107916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.107916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.107916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.107916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.107916] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.108166] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.108166] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.108213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.108343] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.108442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.108492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.108634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.108709] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.108790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.109619] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.327964] env[66519]: INFO networking_nsxv3.common.synchronization [req-55e6d925-f0eb-413e-a596-06547e866bda req-11785c06-b264-411a-a165-6a1e54de33d4 tempest-ServersV294TestFqdnHostnames-1610063464 tempest-ServersV294TestFqdnHostnames-1610063464-project-member] Enqueued Resource ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 with Priority: HIGHEST for action security_group_members [ 875.328526] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 with Priority: HIGHEST for action security_group_members [ 875.328838] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.328988] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.329087] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.329277] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.329435] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.329590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.329590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.329887] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.329887] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.329887] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b539ffb-57a2-420e-8eb3-8a80c9021bc6',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.429034] env[66519]: INFO networking_nsxv3.common.synchronization [req-6c510e3f-daf9-49d8-af62-e8a651212a12 req-9b22e7b6-a017-424d-bf45-74768123091b tempest-ListServerFiltersTestJSON-365692851 tempest-ListServerFiltersTestJSON-365692851-project-member] Enqueued Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_members [ 875.429034] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8806842e-05bb-42d4-891f-7827a3b60a33 with Priority: HIGHEST for action security_group_members [ 875.429034] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8806842e-05bb-42d4-891f-7827a3b60a33 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.429401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.429580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.429886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.431579] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.431579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.431579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.431579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.431579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.431579] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8806842e-05bb-42d4-891f-7827a3b60a33',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.613236] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb1cadf6-d26e-4714-b83e-0fcbe235e2e5: rpc.has_security_group_logging(os_id): False [ 875.635021] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.635021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.635248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.636034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.636034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.636034] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.636034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.636034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.636235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.636276] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.636609] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.636762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.636857] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.637178] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.637178] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.637299] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.637423] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.637463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.637606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.637698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.637784] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 875.716773] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.716979] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.717089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.717297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.717534] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.731905] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 875.833279] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.833279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.833279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.833279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.833279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.833546] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.833546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.833675] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.833781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.833828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.833928] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 is going to be updated. [ 875.871521] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.871795] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.871795] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.871958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.872241] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.883300] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 in Status: IN_PROGRESS for 2s [ 875.933515] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.933729] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.933838] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.934172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.964478] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.966503] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.966503] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.968111] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.968487] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.968722] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.969292] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8806842e-05bb-42d4-891f-7827a3b60a33 is going to be updated. [ 876.011603] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.013454] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.013454] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.013454] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.013454] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.026120] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: IN_PROGRESS for 2s [ 877.397210] env[66519]: INFO networking_nsxv3.common.synchronization [req-64a7a4ee-21a1-4020-87c5-734f3fd1c1d8 req-72b7a102-b918-4926-897b-5fda9b387765 tempest-ServersNegativeTestMultiTenantJSON-453304481 tempest-ServersNegativeTestMultiTenantJSON-453304481-project-member] Enqueued Resource ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 with Priority: HIGHEST for action security_group_members [ 877.398121] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 with Priority: HIGHEST for action security_group_members [ 877.398683] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-76ce9371-2113-4da6-8d86-1fcee6902f41 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.398941] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.399140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.399521] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.399838] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.400211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.400211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.400538] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.400761] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.400976] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('76ce9371-2113-4da6-8d86-1fcee6902f41',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.526630] env[66519]: INFO networking_nsxv3.common.synchronization [None req-09744942-4212-47fc-a3e3-3fdad090142d None None] Enqueued Resource ID: a9b468e4-b047-4bac-9f7c-81553292dc21 with Priority: HIGHEST for action port [ 877.527221] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b468e4-b047-4bac-9f7c-81553292dc21 with Priority: HIGHEST for action port [ 877.527519] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9b468e4-b047-4bac-9f7c-81553292dc21 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.527663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9b468e4-b047-4bac-9f7c-81553292dc21" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.527733] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9b468e4-b047-4bac-9f7c-81553292dc21" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.527993] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9b468e4-b047-4bac-9f7c-81553292dc21" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.528098] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9b468e4-b047-4bac-9f7c-81553292dc21',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.755297] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 877.755297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.898972] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 in Status: SUCCESS [ 877.898972] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b539ffb-57a2-420e-8eb3-8a80c9021bc6 deletion is rescheduled due to dependency. [ 877.898972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b539ffb-57a2-420e-8eb3-8a80c9021bc6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.905419] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.905572] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.905657] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.906495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.906495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.906495] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.906495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.906495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.906495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.906782] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.906782] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 is going to be updated. [ 877.943720] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.943720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.943720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.943720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.943720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.955258] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 in Status: IN_PROGRESS for 2s [ 878.032789] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9b468e4-b047-4bac-9f7c-81553292dc21 [ 878.033033] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.033224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.033224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.033433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.033518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.033607] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9b468e4-b047-4bac-9f7c-81553292dc21 already deleted. [ 878.033684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9b468e4-b047-4bac-9f7c-81553292dc21" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.039872] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8806842e-05bb-42d4-891f-7827a3b60a33 in Status: SUCCESS [ 878.040134] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8806842e-05bb-42d4-891f-7827a3b60a33 deletion is rescheduled due to dependency. [ 878.040253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8806842e-05bb-42d4-891f-7827a3b60a33" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.746559] env[66519]: INFO networking_nsxv3.common.synchronization [None req-50b20f8d-f28a-4f11-be45-69025351396b tempest-ServerActionsTestJSON-1487893254 tempest-ServerActionsTestJSON-1487893254-project-member] Enqueued Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_rules [ 878.751297] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_rules [ 878.752020] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.752020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.752020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.752251] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.752331] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.885218] env[66519]: INFO networking_nsxv3.common.synchronization [None req-31941c47-8c86-474a-98c5-64cbcb7584ae tempest-ServerActionsTestJSON-1487893254 tempest-ServerActionsTestJSON-1487893254-project-member] Enqueued Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_rules [ 878.885816] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_rules [ 878.886172] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.886267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.276025] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.276025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.276025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.276025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.276025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.276025] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb already deleted. [ 879.276025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.276025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.276025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.276025] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.804825] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.805243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.805243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.805553] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.805553] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.805648] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb already deleted. [ 879.805739] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.969280] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 in Status: SUCCESS [ 879.969732] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 deletion is rescheduled due to dependency. [ 879.969732] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.818442] env[66519]: INFO networking_nsxv3.common.synchronization [None req-4cacc825-28ff-4b31-bb27-f5855a946d2e None None] Enqueued Resource ID: de6ce130-3781-4604-aea5-48dc1d607c80 with Priority: HIGHEST for action port [ 880.819175] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de6ce130-3781-4604-aea5-48dc1d607c80 with Priority: HIGHEST for action port [ 880.819634] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-de6ce130-3781-4604-aea5-48dc1d607c80 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.819843] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de6ce130-3781-4604-aea5-48dc1d607c80" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.819957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de6ce130-3781-4604-aea5-48dc1d607c80" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.821601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de6ce130-3781-4604-aea5-48dc1d607c80" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.821601] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de6ce130-3781-4604-aea5-48dc1d607c80',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.325661] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de6ce130-3781-4604-aea5-48dc1d607c80 [ 881.325661] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.325661] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.325661] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.326065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.326065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.326065] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de6ce130-3781-4604-aea5-48dc1d607c80 already deleted. [ 881.326065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de6ce130-3781-4604-aea5-48dc1d607c80" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.937152] env[66519]: INFO networking_nsxv3.common.synchronization [req-a15377cf-379b-4a32-af6e-57cd8f3375dd req-c3866e06-8c7f-418f-b344-98a2660d538f tempest-ServerPasswordTestJSON-210038778 tempest-ServerPasswordTestJSON-210038778-project-member] Enqueued Resource ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 with Priority: HIGHEST for action security_group_members [ 881.937762] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 with Priority: HIGHEST for action security_group_members [ 881.938079] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ff4300a-fb40-480e-bce1-da4cdaede807 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.938257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.938328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.938527] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.938714] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.938813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.938890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.939068] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.939172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.939414] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ff4300a-fb40-480e-bce1-da4cdaede807',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.441999] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.442205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.442328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.442577] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.442998] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.442998] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.443138] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.443138] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.443277] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.443380] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.443504] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 is going to be updated. [ 882.482122] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.482122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.482122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.482122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.482122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.498451] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 in Status: IN_PROGRESS for 2s [ 882.865801] env[66519]: INFO networking_nsxv3.common.synchronization [req-8d461f08-12c3-43c4-8002-78c08c24ba05 req-44f6a050-95d5-4f74-8146-20b7624fdca7 tempest-ServerTagsTestJSON-2119874987 tempest-ServerTagsTestJSON-2119874987-project-member] Enqueued Resource ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 with Priority: HIGHEST for action security_group_members [ 882.866418] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 with Priority: HIGHEST for action security_group_members [ 882.866768] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bce1c878-084f-4aa4-935c-834b7a1e28f9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.866899] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.866975] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.874295] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.874446] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.874539] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.874600] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.874775] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.874861] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.874960] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bce1c878-084f-4aa4-935c-834b7a1e28f9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.141294] env[66519]: INFO networking_nsxv3.common.synchronization [req-4a534a20-aaff-4407-ab29-ab9f1b8224d3 req-8350e1a2-a51f-4911-9a2f-718915deae31 tempest-ServersTestJSON-971253557 tempest-ServersTestJSON-971253557-project-member] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 883.143717] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 883.144118] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.144280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.144388] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.144629] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.144888] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.145375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.145375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.145375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.145486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.145486] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.379044] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.379044] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.379044] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.379044] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.379044] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.379044] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.379044] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.379044] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.379445] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.379445] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.379445] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 already deleted. [ 883.379445] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.402296] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.402496] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-690" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.402632] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-690" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.403969] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-690" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.404381] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.404608] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.404766] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.405040] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.405222] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.405466] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.405623] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.405757] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.405858] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.406030] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.406151] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.406309] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.433573] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.433573] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 883.433573] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.433573] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-690" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.433832] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-de4e9039-20a0-4f3c-94cc-70031f84812f taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.434014] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-de4e9039-20a0-4f3c-94cc-70031f84812f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.434288] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-de4e9039-20a0-4f3c-94cc-70031f84812f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.434695] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-de4e9039-20a0-4f3c-94cc-70031f84812f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.434833] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de4e9039-20a0-4f3c-94cc-70031f84812f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.650330] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.938549] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.938809] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.938936] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.939286] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.939409] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.939573] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port de4e9039-20a0-4f3c-94cc-70031f84812f not found, creating... [ 883.939862] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.940033] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.940289] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.940384] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.940492] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.940770] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.940937] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.941084] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.941266] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.941454] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.941895] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: de4e9039-20a0-4f3c-94cc-70031f84812f is going to be created. [ 883.964584] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.965844] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.965844] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.965844] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.965844] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.966028] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-de4e9039-20a0-4f3c-94cc-70031f84812f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.153252] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.531959] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 in Status: SUCCESS [ 884.532301] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 deletion is rescheduled due to dependency. [ 884.532359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.656984] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.656984] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.657117] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.657311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.657404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.657500] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 884.700993] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.701195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.701257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.701461] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.701618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.716798] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 884.729239] env[66519]: INFO networking_nsxv3.common.synchronization [req-8d461f08-12c3-43c4-8002-78c08c24ba05 req-a36739ea-5d36-407b-9969-914338bb049a service nova] Enqueued Resource ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 with Priority: HIGHEST for action security_group_rules [ 884.729239] env[66519]: INFO networking_nsxv3.common.synchronization [req-8d461f08-12c3-43c4-8002-78c08c24ba05 req-a36739ea-5d36-407b-9969-914338bb049a service nova] Enqueued Resource ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 with Priority: HIGHEST for action security_group_members [ 884.729239] env[66519]: INFO networking_nsxv3.common.synchronization [req-8d461f08-12c3-43c4-8002-78c08c24ba05 req-a36739ea-5d36-407b-9969-914338bb049a service nova] Enqueued Resource ID: de4e9039-20a0-4f3c-94cc-70031f84812f with Priority: HIGHEST for action port [ 884.729660] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 with Priority: HIGHEST for action security_group_rules [ 884.730119] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 with Priority: HIGHEST for action security_group_members [ 884.730281] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de4e9039-20a0-4f3c-94cc-70031f84812f with Priority: HIGHEST for action port [ 884.730579] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bce1c878-084f-4aa4-935c-834b7a1e28f9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.730700] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.730763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.731041] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.731123] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bce1c878-084f-4aa4-935c-834b7a1e28f9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.732141] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bce1c878-084f-4aa4-935c-834b7a1e28f9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.732260] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.732329] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.732496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.732644] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.732736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.732793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.732935] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.733029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.733118] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bce1c878-084f-4aa4-935c-834b7a1e28f9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.735349] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-de4e9039-20a0-4f3c-94cc-70031f84812f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.735349] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de4e9039-20a0-4f3c-94cc-70031f84812f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.735349] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de4e9039-20a0-4f3c-94cc-70031f84812f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.735349] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de4e9039-20a0-4f3c-94cc-70031f84812f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.735349] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de4e9039-20a0-4f3c-94cc-70031f84812f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.237687] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bce1c878-084f-4aa4-935c-834b7a1e28f9 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.238087] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.238087] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bce1c878-084f-4aa4-935c-834b7a1e28f9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.239884] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de4e9039-20a0-4f3c-94cc-70031f84812f with status ACTIVE [ 885.240070] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.240196] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.240261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.240469] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.240559] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.240848] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.240848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.240977] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.241216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.241216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.241306] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.241712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.241712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.241712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.241712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.242285] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de4e9039-20a0-4f3c-94cc-70031f84812f is going to be updated. [ 885.266221] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.266455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.266528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.266845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.266995] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.267174] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de4e9039-20a0-4f3c-94cc-70031f84812f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.495024] env[66519]: INFO networking_nsxv3.common.synchronization [req-dd5db49a-a2bb-46f1-9f2e-1875a3e7a15f req-c9b348ac-d4cc-48a4-abdb-93ee80f7175a tempest-ServerActionsTestOtherB-865317477 tempest-ServerActionsTestOtherB-865317477-project-member] Enqueued Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 885.495988] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 885.495988] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.496199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.496199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.496459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.496741] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.496847] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.496907] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.497546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.497675] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.497802] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.741390] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bce1c878-084f-4aa4-935c-834b7a1e28f9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.820818] env[66519]: INFO networking_nsxv3.common.synchronization [None req-11a71b76-be52-480f-8bc6-848934b6edc3 None None] Enqueued Resource ID: ff560e93-9f33-477d-bb9c-3e8fcc5ddcbf with Priority: HIGHEST for action port [ 885.820818] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff560e93-9f33-477d-bb9c-3e8fcc5ddcbf with Priority: HIGHEST for action port [ 885.820818] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff560e93-9f33-477d-bb9c-3e8fcc5ddcbf taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.820818] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff560e93-9f33-477d-bb9c-3e8fcc5ddcbf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.820818] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff560e93-9f33-477d-bb9c-3e8fcc5ddcbf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.821869] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff560e93-9f33-477d-bb9c-3e8fcc5ddcbf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.821869] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff560e93-9f33-477d-bb9c-3e8fcc5ddcbf',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.905027] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-806 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.905027] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-806" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.905027] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-806" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.905027] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-806" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.905341] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.905679] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.905941] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.906320] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.907021] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.907483] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.907769] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.908021] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.908239] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.909566] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.909566] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.909566] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.933238] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.933422] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 885.934063] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.934063] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-806" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.934063] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-3bcda299-ae00-4d21-844e-f05e98e195c3 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.934269] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-3bcda299-ae00-4d21-844e-f05e98e195c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.934269] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-3bcda299-ae00-4d21-844e-f05e98e195c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.934688] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-3bcda299-ae00-4d21-844e-f05e98e195c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.934863] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bcda299-ae00-4d21-844e-f05e98e195c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.000118] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.000316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.000359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.000611] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.000710] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.000935] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.001057] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.001121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.001297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.001372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.001467] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee already deleted. [ 886.001549] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.244490] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.244490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.244490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.244490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.244490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.245044] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 is going to be created. [ 886.273767] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.276023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.276023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.276023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.276023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.287529] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 in Status: UNINITIALIZED for 2s [ 886.327065] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff560e93-9f33-477d-bb9c-3e8fcc5ddcbf [ 886.327065] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.327065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.327065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.327065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.327065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.327065] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff560e93-9f33-477d-bb9c-3e8fcc5ddcbf already deleted. [ 886.327065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff560e93-9f33-477d-bb9c-3e8fcc5ddcbf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.437118] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.437398] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.437469] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.437794] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.437969] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.438202] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 3bcda299-ae00-4d21-844e-f05e98e195c3 not found, creating... [ 886.438492] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.438655] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.438788] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.439091] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.439338] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.439639] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.439797] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.439928] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.440171] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.440307] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.440445] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 3bcda299-ae00-4d21-844e-f05e98e195c3 is going to be created. [ 886.463452] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.463667] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.463807] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.464116] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.464361] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.464697] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-3bcda299-ae00-4d21-844e-f05e98e195c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.730252] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 886.730252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.214972] env[66519]: INFO networking_nsxv3.common.synchronization [req-dd5db49a-a2bb-46f1-9f2e-1875a3e7a15f req-e5eccaf1-847b-468d-81a1-59cedaad3302 service nova] Enqueued Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_rules [ 887.215204] env[66519]: INFO networking_nsxv3.common.synchronization [req-dd5db49a-a2bb-46f1-9f2e-1875a3e7a15f req-e5eccaf1-847b-468d-81a1-59cedaad3302 service nova] Enqueued Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 887.215370] env[66519]: INFO networking_nsxv3.common.synchronization [req-dd5db49a-a2bb-46f1-9f2e-1875a3e7a15f req-e5eccaf1-847b-468d-81a1-59cedaad3302 service nova] Enqueued Resource ID: 3bcda299-ae00-4d21-844e-f05e98e195c3 with Priority: HIGHEST for action port [ 887.215856] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_rules [ 887.215992] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 887.217192] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bcda299-ae00-4d21-844e-f05e98e195c3 with Priority: HIGHEST for action port [ 887.217502] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.217638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.217721] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.218509] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.218509] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.218852] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.218964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.219038] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.219207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.219778] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.219778] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.219778] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.219778] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.219778] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.219778] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.221443] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bcda299-ae00-4d21-844e-f05e98e195c3 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.221443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bcda299-ae00-4d21-844e-f05e98e195c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.221443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bcda299-ae00-4d21-844e-f05e98e195c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.221776] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bcda299-ae00-4d21-844e-f05e98e195c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.221836] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bcda299-ae00-4d21-844e-f05e98e195c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.329862] env[66519]: INFO networking_nsxv3.common.synchronization [None req-86ee7bd8-dcab-4cd2-a3ef-6e5491773030 tempest-ServersTestManualDisk-1887932989 tempest-ServersTestManualDisk-1887932989-project-member] Enqueued Resource ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 with Priority: HIGHEST for action security_group_rules [ 887.333199] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 with Priority: HIGHEST for action security_group_rules [ 887.333199] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.333199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.333199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.333199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.333199] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb0f115b-2ae8-4ea8-bf0a-99edddaaee58',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.451467] env[66519]: INFO networking_nsxv3.common.synchronization [None req-e1aab8d0-df4d-4949-886a-899ef2759073 tempest-ServersTestManualDisk-1887932989 tempest-ServersTestManualDisk-1887932989-project-member] Enqueued Resource ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 with Priority: HIGHEST for action security_group_rules [ 887.451999] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 with Priority: HIGHEST for action security_group_rules [ 887.452219] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.452315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.724568] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.725471] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.725471] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.725796] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bcda299-ae00-4d21-844e-f05e98e195c3 with status ACTIVE [ 887.726435] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.726435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.726435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.726435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.726435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.726848] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.726848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.726848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.727919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.727919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.727919] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.727919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.727919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.727919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.727919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.727919] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bcda299-ae00-4d21-844e-f05e98e195c3 is going to be updated. [ 887.751558] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.751737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.751785] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.752081] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.752153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.752302] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bcda299-ae00-4d21-844e-f05e98e195c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.855778] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.855926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.856360] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.856360] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.856360] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.856473] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 already deleted. [ 887.856473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.856705] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.856922] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.856994] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb0f115b-2ae8-4ea8-bf0a-99edddaaee58',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.053787] env[66519]: INFO networking_nsxv3.common.synchronization [None req-5732106e-33ce-49c8-9f63-23c225147466 None None] Enqueued Resource ID: ef8c6b25-72b3-4a72-964e-70edc6cb09dc with Priority: HIGHEST for action port [ 888.053875] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef8c6b25-72b3-4a72-964e-70edc6cb09dc with Priority: HIGHEST for action port [ 888.054173] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef8c6b25-72b3-4a72-964e-70edc6cb09dc taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.054290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef8c6b25-72b3-4a72-964e-70edc6cb09dc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.054354] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef8c6b25-72b3-4a72-964e-70edc6cb09dc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.054679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef8c6b25-72b3-4a72-964e-70edc6cb09dc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.054767] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef8c6b25-72b3-4a72-964e-70edc6cb09dc',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.226471] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.298512] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 in Status: SUCCESS [ 888.298688] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.298868] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.299143] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.299341] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.299460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.299528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.299681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.299794] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.299917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.300030] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bce1c878-084f-4aa4-935c-834b7a1e28f9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.386986] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.386986] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.386986] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.386986] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.386986] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.386986] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 already deleted. [ 888.386986] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.559474] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef8c6b25-72b3-4a72-964e-70edc6cb09dc [ 888.559474] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.559474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.559474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.559474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.559474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.559474] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef8c6b25-72b3-4a72-964e-70edc6cb09dc already deleted. [ 888.559474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef8c6b25-72b3-4a72-964e-70edc6cb09dc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.731590] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.731893] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.731893] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.732159] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.732269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.732363] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee is going to be created. [ 888.758372] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.758372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.758372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.758605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.758637] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.768847] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: UNINITIALIZED for 2s [ 888.802694] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bce1c878-084f-4aa4-935c-834b7a1e28f9 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.802846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.802940] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.803177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.803346] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.803447] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.803505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.803654] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.803744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.803834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.803981] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bce1c878-084f-4aa4-935c-834b7a1e28f9 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.804086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.804153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.804283] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.804416] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.804505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.804574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.804699] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.804770] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.804848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.804936] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bce1c878-084f-4aa4-935c-834b7a1e28f9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.308538] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bce1c878-084f-4aa4-935c-834b7a1e28f9: rpc.has_security_group_logging(os_id): False [ 889.331573] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.331920] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.331920] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.332279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.332279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.332477] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.332477] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.332477] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.332730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.332730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.333041] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.333139] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.333253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.334062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.334062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.334062] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.334062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.334062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.334062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.334062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.334062] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 is going to be created. [ 889.427397] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.427724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.427724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.428455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.428455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.443749] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 in Status: IN_PROGRESS for 2s [ 889.908227] env[66519]: INFO networking_nsxv3.common.synchronization [req-c1d1c033-8b18-4749-a81f-b95244778680 req-2562e35f-3e95-45f6-8868-94bf8d9b477c tempest-MigrationsAdminTest-1659008040 tempest-MigrationsAdminTest-1659008040-project-member] Enqueued Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGHEST for action security_group_members [ 889.908227] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGHEST for action security_group_members [ 889.908227] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.908227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.908227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.908421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.909158] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.909158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.909158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.909158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.909158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.909158] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.411929] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.781396] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: SUCCESS [ 890.781726] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.781726] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.781910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.782047] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.782170] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.782238] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.782409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.782501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.782588] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.782688] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.915082] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.286143] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.418228] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.418440] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.418440] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.418648] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.419783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.419783] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cb7c090-e083-487a-aa5d-420200af9bce is going to be updated. [ 891.452243] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.452243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.452243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.452401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.452401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.455192] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 in Status: SUCCESS [ 891.455192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.460902] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cb7c090-e083-487a-aa5d-420200af9bce in Status: IN_PROGRESS for 2s [ 891.788061] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7af6979-b772-40ee-bdb9-b29ca300beee: rpc.has_security_group_logging(os_id): False [ 891.808143] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.808349] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.808438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.808744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.808817] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.809131] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.809281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.809337] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.809713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.809713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.809713] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee is going to be created. [ 891.868489] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.868723] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.868864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.869200] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.869516] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.880946] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: IN_PROGRESS for 2s [ 892.315527] env[66519]: INFO networking_nsxv3.common.synchronization [req-de2ccdd6-da37-4601-ac47-ae543630362d req-397c4728-c564-4f4a-a949-e4630186e988 tempest-ImagesTestJSON-1420515381 tempest-ImagesTestJSON-1420515381-project-member] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 892.316162] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 892.317314] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.317314] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.317314] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.317314] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.317314] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.317314] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.317314] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.317734] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.317734] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.317734] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.659231] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-161 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.659451] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.659594] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.659885] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.663157] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.663520] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.664296] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.664598] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.664898] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.665247] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.665444] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.665630] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.665773] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.665916] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.666048] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.666200] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.686163] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.686163] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 892.686163] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.686163] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.686163] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-0e850d6e-b14e-480d-b1ba-98643910eb57 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.686372] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-0e850d6e-b14e-480d-b1ba-98643910eb57" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.686372] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-0e850d6e-b14e-480d-b1ba-98643910eb57" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.686664] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-0e850d6e-b14e-480d-b1ba-98643910eb57" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.686836] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e850d6e-b14e-480d-b1ba-98643910eb57',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.820084] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.820437] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.820437] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.820647] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.820797] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.821322] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.821322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.821322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.821513] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.821679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.821784] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be updated. [ 892.855754] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.855754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.855754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.855754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.855754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.866663] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: IN_PROGRESS for 2s [ 892.873755] env[66519]: INFO networking_nsxv3.common.synchronization [req-ac85c4a8-09b9-4a34-9049-bee27d310f27 req-ad3fe72c-5129-4bfe-9bd8-fe9926351f3c tempest-FloatingIPsAssociationTestJSON-1821391314 tempest-FloatingIPsAssociationTestJSON-1821391314-project-member] Enqueued Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGHEST for action security_group_members [ 892.874337] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGHEST for action security_group_members [ 892.874676] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.875021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.875021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.875193] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.875382] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.875479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.875479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.875664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.875749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.875856] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.193136] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.193412] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.193580] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.193892] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.194086] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.194269] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 0e850d6e-b14e-480d-b1ba-98643910eb57 not found, creating... [ 893.194607] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.194783] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.194919] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.195165] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.195302] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.195584] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.195735] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.195849] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.196058] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.196186] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.196321] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 0e850d6e-b14e-480d-b1ba-98643910eb57 is going to be created. [ 893.218966] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.219196] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.219370] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.219797] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.219848] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.220055] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-0e850d6e-b14e-480d-b1ba-98643910eb57" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.378558] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.378785] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.378859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.379404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.379404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.379638] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.379762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.379858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.379998] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.380084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.380187] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34191aa8-8997-42e0-88cc-151380dc439e is going to be updated. [ 893.419129] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.419392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.419392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.419662] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.419866] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.431234] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34191aa8-8997-42e0-88cc-151380dc439e in Status: IN_PROGRESS for 2s [ 893.471419] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cb7c090-e083-487a-aa5d-420200af9bce in Status: SUCCESS [ 893.471599] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.895546] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: SUCCESS [ 893.895895] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.936583] env[66519]: INFO networking_nsxv3.common.synchronization [req-de2ccdd6-da37-4601-ac47-ae543630362d req-f6ca0907-8fdc-4e46-9b61-bfbd22e54029 service nova] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_rules [ 893.936825] env[66519]: INFO networking_nsxv3.common.synchronization [req-de2ccdd6-da37-4601-ac47-ae543630362d req-f6ca0907-8fdc-4e46-9b61-bfbd22e54029 service nova] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 893.937017] env[66519]: INFO networking_nsxv3.common.synchronization [req-de2ccdd6-da37-4601-ac47-ae543630362d req-f6ca0907-8fdc-4e46-9b61-bfbd22e54029 service nova] Enqueued Resource ID: 0e850d6e-b14e-480d-b1ba-98643910eb57 with Priority: HIGHEST for action port [ 893.937701] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_rules [ 893.937925] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 893.938035] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e850d6e-b14e-480d-b1ba-98643910eb57 with Priority: HIGHEST for action port [ 893.938407] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.938570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.938666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.938937] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.939102] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.940262] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.940390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.940659] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e850d6e-b14e-480d-b1ba-98643910eb57 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.940801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e850d6e-b14e-480d-b1ba-98643910eb57" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.940892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e850d6e-b14e-480d-b1ba-98643910eb57" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.941151] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e850d6e-b14e-480d-b1ba-98643910eb57" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.941249] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e850d6e-b14e-480d-b1ba-98643910eb57',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.445743] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.445743] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.445743] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e850d6e-b14e-480d-b1ba-98643910eb57 with status ACTIVE [ 894.445743] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.445958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.445958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.446505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.447126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.447126] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.447126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.447305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.447408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.447464] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.447668] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.447793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.447869] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.448012] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.448079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.448177] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e850d6e-b14e-480d-b1ba-98643910eb57 is going to be updated. [ 894.480317] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.480498] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.480558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.480754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.480895] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.481073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e850d6e-b14e-480d-b1ba-98643910eb57" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.876585] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: SUCCESS [ 894.876832] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 deletion is rescheduled due to dependency. [ 894.876950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.877134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.877345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.877646] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.877646] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.877816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.877890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.877972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.878094] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.905964] env[66519]: INFO networking_nsxv3.common.synchronization [req-51cc3570-114f-4475-9a97-14a9cc194bfe req-c2dd8aca-08c4-4ca8-8ef9-ff659f25034b tempest-ServersTestJSON-1970727514 tempest-ServersTestJSON-1970727514-project-member] Enqueued Resource ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 with Priority: HIGHEST for action security_group_members [ 894.905964] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 with Priority: HIGHEST for action security_group_members [ 894.905964] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.906405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.906405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.906491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.907172] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.907172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.907172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.907172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.907172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.907172] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.203417] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-554 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.203613] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-554" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.203735] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-554" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.204068] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-554" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.204332] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.204492] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.204634] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.204855] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.204995] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.205206] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.205318] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.205421] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.205526] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.205632] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.205735] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.205862] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.229169] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.229354] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 895.229468] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.229640] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-554" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.229965] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-51396007-c524-422d-a417-147aa9910d0e taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.230144] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-51396007-c524-422d-a417-147aa9910d0e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.230259] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-51396007-c524-422d-a417-147aa9910d0e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.230571] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-51396007-c524-422d-a417-147aa9910d0e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.230938] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51396007-c524-422d-a417-147aa9910d0e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.380332] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.410137] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.410309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.410381] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.410590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.410678] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.410873] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.410976] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.411057] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.411211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.411345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.411452] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 already deleted. [ 895.411452] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.443246] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34191aa8-8997-42e0-88cc-151380dc439e in Status: SUCCESS [ 895.443428] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34191aa8-8997-42e0-88cc-151380dc439e deletion is rescheduled due to dependency. [ 895.443544] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.735239] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.735642] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.735642] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.735864] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.736116] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.736284] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 51396007-c524-422d-a417-147aa9910d0e not found, creating... [ 895.736558] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.736784] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.736899] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.737155] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.737290] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.741476] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.741476] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.741476] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.741476] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.741476] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.741476] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 51396007-c524-422d-a417-147aa9910d0e is going to be created. [ 895.769327] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.769327] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.769327] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.769327] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.769327] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.769851] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-51396007-c524-422d-a417-147aa9910d0e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.883273] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.388274] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.388274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.388274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.388274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.388274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.388274] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be updated. [ 896.422980] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.423150] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.423222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.423439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.423590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.432721] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: IN_PROGRESS for 2s [ 896.497743] env[66519]: INFO networking_nsxv3.common.synchronization [req-51cc3570-114f-4475-9a97-14a9cc194bfe req-060c04e1-6f68-4c79-9212-4e726ee8b0d3 service nova] Enqueued Resource ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 with Priority: HIGHEST for action security_group_rules [ 896.497924] env[66519]: INFO networking_nsxv3.common.synchronization [req-51cc3570-114f-4475-9a97-14a9cc194bfe req-060c04e1-6f68-4c79-9212-4e726ee8b0d3 service nova] Enqueued Resource ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 with Priority: HIGHEST for action security_group_members [ 896.498299] env[66519]: INFO networking_nsxv3.common.synchronization [req-51cc3570-114f-4475-9a97-14a9cc194bfe req-060c04e1-6f68-4c79-9212-4e726ee8b0d3 service nova] Enqueued Resource ID: 51396007-c524-422d-a417-147aa9910d0e with Priority: HIGHEST for action port [ 896.498608] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 with Priority: HIGHEST for action security_group_rules [ 896.499494] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 with Priority: HIGHEST for action security_group_members [ 896.499494] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51396007-c524-422d-a417-147aa9910d0e with Priority: HIGHEST for action port [ 896.499494] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.499494] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.499494] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.499740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.499828] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.502203] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.502325] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.502405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.502597] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.502758] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.502862] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.502921] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.503100] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.503186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.503276] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.508526] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-51396007-c524-422d-a417-147aa9910d0e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.508677] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51396007-c524-422d-a417-147aa9910d0e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.508721] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51396007-c524-422d-a417-147aa9910d0e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.508910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51396007-c524-422d-a417-147aa9910d0e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.509025] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51396007-c524-422d-a417-147aa9910d0e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.003364] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.003364] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.009465] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.011559] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51396007-c524-422d-a417-147aa9910d0e with status ACTIVE [ 897.011772] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.011906] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.011968] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.012183] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.012265] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.012447] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.012548] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.012609] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.012762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.012837] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.013014] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.013653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.013653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.013653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.013653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.013653] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51396007-c524-422d-a417-147aa9910d0e is going to be updated. [ 897.048227] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.048423] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.048502] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.048796] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.049078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.049313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51396007-c524-422d-a417-147aa9910d0e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.327153] env[66519]: INFO networking_nsxv3.common.synchronization [req-4bf46f16-8d3b-474d-be1c-5d1072af520d req-73def77b-7be4-43e5-af69-80eae9a38c8b tempest-ServerTagsTestJSON-2119874987 tempest-ServerTagsTestJSON-2119874987-project-member] Enqueued Resource ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 with Priority: HIGHEST for action security_group_members [ 897.328145] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 with Priority: HIGHEST for action security_group_members [ 897.328627] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bce1c878-084f-4aa4-935c-834b7a1e28f9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.328627] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.328754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.328858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.329373] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.330668] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.330796] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.330921] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.331017] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.331121] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bce1c878-084f-4aa4-935c-834b7a1e28f9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.515479] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.833595] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.833720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.833761] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.833973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.834088] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.834318] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.834396] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.834459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.834612] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.834929] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.835752] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 is going to be updated. [ 897.868194] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.868194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.868194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.868194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.868194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.877658] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 in Status: IN_PROGRESS for 2s [ 897.966933] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.966933] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-887" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.966933] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-887" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.966933] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-887" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.967193] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.967349] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.967464] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.967837] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.968224] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.968483] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.968621] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 897.968740] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 897.968909] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 897.969107] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.969282] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 897.969482] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 897.990445] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 897.990610] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 897.990756] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 897.990929] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-887" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.991594] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-e5ced596-1881-43b1-b3d3-59261afdf0e7 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.991594] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-e5ced596-1881-43b1-b3d3-59261afdf0e7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.991594] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-e5ced596-1881-43b1-b3d3-59261afdf0e7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.991798] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-e5ced596-1881-43b1-b3d3-59261afdf0e7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.991933] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5ced596-1881-43b1-b3d3-59261afdf0e7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.017966] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.018147] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.018219] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.018425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.018510] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.019345] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 is going to be created. [ 898.045363] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.045494] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.045494] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.045672] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.045834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.056989] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 in Status: UNINITIALIZED for 2s [ 898.448079] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: SUCCESS [ 898.448079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.448079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.448079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.448079] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.448507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.448507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.448691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.448691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.448691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.448786] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.494388] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.494619] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.494816] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.495155] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.495305] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.495679] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.495852] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.495967] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.496201] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.496334] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.496738] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.496952] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.497106] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.497320] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.497453] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.497606] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: e5ced596-1881-43b1-b3d3-59261afdf0e7 is going to be updated. [ 898.523704] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.524203] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.524203] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.524432] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.524847] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.525153] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-e5ced596-1881-43b1-b3d3-59261afdf0e7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.951634] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.951767] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.951810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.951998] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.952193] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.952359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.952393] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.952554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.952704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.952756] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.952909] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.953047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.953074] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.953218] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.953441] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.953548] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.953639] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.953799] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.953832] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.953900] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.954015] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.255524] env[66519]: INFO networking_nsxv3.common.synchronization [req-f38e3e02-643b-4073-9bae-97b685091e04 req-41a387db-f8f5-47d6-b043-17f0e74f07ca service nova] Enqueued Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_rules [ 899.255717] env[66519]: INFO networking_nsxv3.common.synchronization [req-f38e3e02-643b-4073-9bae-97b685091e04 req-41a387db-f8f5-47d6-b043-17f0e74f07ca service nova] Enqueued Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_members [ 899.255853] env[66519]: INFO networking_nsxv3.common.synchronization [req-f38e3e02-643b-4073-9bae-97b685091e04 req-41a387db-f8f5-47d6-b043-17f0e74f07ca service nova] Enqueued Resource ID: e5ced596-1881-43b1-b3d3-59261afdf0e7 with Priority: HIGHEST for action port [ 899.256373] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_rules [ 899.256510] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_members [ 899.256609] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5ced596-1881-43b1-b3d3-59261afdf0e7 with Priority: HIGHEST for action port [ 899.256950] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.257382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.257382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.257382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.257598] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.258393] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.258493] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.258566] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.258709] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.258850] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.259105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.259105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.259188] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.259257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.259351] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.262880] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5ced596-1881-43b1-b3d3-59261afdf0e7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.262880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5ced596-1881-43b1-b3d3-59261afdf0e7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.262880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5ced596-1881-43b1-b3d3-59261afdf0e7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.262880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5ced596-1881-43b1-b3d3-59261afdf0e7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.262880] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5ced596-1881-43b1-b3d3-59261afdf0e7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.455961] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c93d149b-db2a-420d-81f5-177c6bdd9505: rpc.has_security_group_logging(os_id): False [ 899.474607] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.474734] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.474772] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.475460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.475460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.475460] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.475460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.475460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.475697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.475697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.475837] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.475933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.475988] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.476273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.476273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.476403] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.476493] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.476579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.476712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.476790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.476877] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be updated. [ 899.539602] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.539896] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.539896] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.540140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.540289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.557827] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: IN_PROGRESS for 2s [ 899.763985] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.764154] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.764371] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.765441] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5ced596-1881-43b1-b3d3-59261afdf0e7 with status ACTIVE [ 899.765536] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.766361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.766361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.766361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.766361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.766361] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.766361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.766677] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.766677] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.766677] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.767567] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.767567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.767567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.767567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.767567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.767567] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5ced596-1881-43b1-b3d3-59261afdf0e7 is going to be updated. [ 899.794130] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.794306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.794348] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.794540] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.794666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.794807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5ced596-1881-43b1-b3d3-59261afdf0e7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.893180] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 in Status: SUCCESS [ 899.893385] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 deletion is rescheduled due to dependency. [ 899.893549] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.068678] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 in Status: SUCCESS [ 900.068908] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.069112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.069327] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.069516] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.069677] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.069782] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.069977] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.070094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.071300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.071300] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.269518] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.572536] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.772521] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.772871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.772986] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.773295] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.773424] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.773541] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f825e83f-7046-4bbd-969b-a037ace80c92 is going to be updated. [ 900.812810] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.812810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.813031] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.813279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.813580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.839889] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: IN_PROGRESS for 2s [ 901.079232] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0: rpc.has_security_group_logging(os_id): False [ 901.108278] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.108278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.108278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.108278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.108278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.108278] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.108278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.108278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.108278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.108278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.108278] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 is going to be created. [ 901.119447] env[66519]: INFO networking_nsxv3.common.synchronization [req-6b6cfd8c-0d8b-4237-81bf-6b9fd7f519d4 req-6ab8624f-073a-45eb-a4b7-f0ba13d4f378 tempest-ImagesOneServerNegativeTestJSON-1631615325 tempest-ImagesOneServerNegativeTestJSON-1631615325-project-member] Enqueued Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_members [ 901.120105] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_members [ 901.120471] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.120597] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.120680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.120871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.121043] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.121156] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.121208] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.121350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.121430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.121520] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.250395] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.250395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.250395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.250395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.250395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.267440] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 in Status: IN_PROGRESS for 2s [ 901.579300] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: SUCCESS [ 901.579300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.589104] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-889 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.589325] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-889" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.589438] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-889" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.589781] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-889" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.591044] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.591044] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.591044] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.591044] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.591044] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.591615] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 901.591615] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 901.591615] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 901.591615] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 901.591809] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 901.591892] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 901.592592] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 901.617571] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 901.617868] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 901.618320] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 901.618690] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-889" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.619314] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-ae944dde-2f7e-43cb-aba5-9309c9e28ee9 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.619885] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-ae944dde-2f7e-43cb-aba5-9309c9e28ee9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.620309] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-ae944dde-2f7e-43cb-aba5-9309c9e28ee9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.620681] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-ae944dde-2f7e-43cb-aba5-9309c9e28ee9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.620937] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae944dde-2f7e-43cb-aba5-9309c9e28ee9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.624542] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.624841] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.624914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.625182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.625482] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.625708] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.625825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.625877] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.626066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.626153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.626236] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ed5e58-fb42-4430-8674-e9d732009460 is going to be updated. [ 901.659269] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.659442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.659563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.659802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.659987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.671183] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: IN_PROGRESS for 2s [ 902.123998] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.124332] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.124483] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.124918] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.125099] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.125273] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port ae944dde-2f7e-43cb-aba5-9309c9e28ee9 not found, creating... [ 902.125593] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.125789] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.125902] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.126204] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.126913] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.127319] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.127516] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.127637] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.127905] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.128058] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.128234] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: ae944dde-2f7e-43cb-aba5-9309c9e28ee9 is going to be created. [ 902.163654] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.163881] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.164018] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.164333] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.164639] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.164893] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-ae944dde-2f7e-43cb-aba5-9309c9e28ee9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.851835] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: SUCCESS [ 902.852251] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.852251] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.852735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.852956] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.853221] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.853221] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.853686] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.853686] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.853686] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.853686] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.917746] env[66519]: INFO networking_nsxv3.common.synchronization [req-6b6cfd8c-0d8b-4237-81bf-6b9fd7f519d4 req-318d3364-2efa-4901-b437-0ad75d949a67 service nova] Enqueued Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_rules [ 902.917926] env[66519]: INFO networking_nsxv3.common.synchronization [req-6b6cfd8c-0d8b-4237-81bf-6b9fd7f519d4 req-318d3364-2efa-4901-b437-0ad75d949a67 service nova] Enqueued Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_members [ 902.918075] env[66519]: INFO networking_nsxv3.common.synchronization [req-6b6cfd8c-0d8b-4237-81bf-6b9fd7f519d4 req-318d3364-2efa-4901-b437-0ad75d949a67 service nova] Enqueued Resource ID: ae944dde-2f7e-43cb-aba5-9309c9e28ee9 with Priority: HIGHEST for action port [ 902.918892] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_rules [ 902.919047] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_members [ 902.919205] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae944dde-2f7e-43cb-aba5-9309c9e28ee9 with Priority: HIGHEST for action port [ 902.919418] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.920144] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.920144] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.920144] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.920144] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.921363] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.921466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.922110] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae944dde-2f7e-43cb-aba5-9309c9e28ee9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.922110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae944dde-2f7e-43cb-aba5-9309c9e28ee9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.922110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae944dde-2f7e-43cb-aba5-9309c9e28ee9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.922110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae944dde-2f7e-43cb-aba5-9309c9e28ee9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.922110] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae944dde-2f7e-43cb-aba5-9309c9e28ee9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.288028] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 in Status: SUCCESS [ 903.288028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.357179] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.357179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.357179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.357179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.357179] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.357179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.357179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.357179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.357179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.357179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.357179] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.357179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.357792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.357792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.357792] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.357792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.357792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.357792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.357950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.357950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.358049] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.422075] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.422230] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.424917] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae944dde-2f7e-43cb-aba5-9309c9e28ee9 with status ACTIVE [ 903.424917] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.425089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.425089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.425964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.425964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.425964] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.425964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.425964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.425964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.425964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.426225] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.426225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.426375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.426408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.426455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.426554] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae944dde-2f7e-43cb-aba5-9309c9e28ee9 is going to be updated. [ 903.450735] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.450907] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.450979] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.451227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.451366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.451532] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae944dde-2f7e-43cb-aba5-9309c9e28ee9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.686659] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: SUCCESS [ 903.688102] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ed5e58-fb42-4430-8674-e9d732009460 deletion is rescheduled due to dependency. [ 903.688102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.688102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.688102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.688102] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.688102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.688102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.688102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.688102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.688548] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.862527] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f825e83f-7046-4bbd-969b-a037ace80c92: rpc.has_security_group_logging(os_id): False [ 903.889315] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.889315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.889315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.889315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.889315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.889315] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.889315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.889315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.889315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.889315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.889315] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.889315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.889315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.890727] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.890727] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.890727] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.890727] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.890727] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.891418] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.893557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.893557] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f825e83f-7046-4bbd-969b-a037ace80c92 is going to be updated. [ 903.975953] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.975953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.975953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.975953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.975953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.030164] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: IN_PROGRESS for 2s [ 904.193419] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.697456] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.203019] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.203019] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.203019] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.203375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.203375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.203375] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ed5e58-fb42-4430-8674-e9d732009460 is going to be updated. [ 905.231715] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.231715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.232149] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.232344] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.232632] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.242681] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: IN_PROGRESS for 2s [ 906.050386] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: SUCCESS [ 906.050636] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.257430] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: SUCCESS [ 907.257760] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.257846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.258117] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.258886] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.258886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.258886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.258886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.258886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.258886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.258886] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.762798] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.763180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.763180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.763284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.763468] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.763556] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.765827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.766075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.766175] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.766290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.766469] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.766586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.766655] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.767421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.767421] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.767421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.767421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.767598] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.767630] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.767720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.767813] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.922983] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 907.922983] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 908.270066] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9ed5e58-fb42-4430-8674-e9d732009460: rpc.has_security_group_logging(os_id): False [ 908.291609] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.291915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.291915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.292065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.292164] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.292396] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.292508] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.292631] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.292849] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.292929] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.293736] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.293736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.293736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.293736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.293736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.294156] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.294156] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.294156] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.294156] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.294305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.294305] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9ed5e58-fb42-4430-8674-e9d732009460 is going to be updated. [ 908.449042] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.449469] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.449599] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.449900] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.450492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.468426] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: IN_PROGRESS for 2s [ 910.102305] env[66519]: INFO networking_nsxv3.common.synchronization [None req-675c0c14-6212-430b-95d0-c4dae264492d None None] Enqueued Resource ID: 99c26a15-b6fd-44ad-abdb-aec2b6a45b50 with Priority: HIGHEST for action port [ 910.102985] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99c26a15-b6fd-44ad-abdb-aec2b6a45b50 with Priority: HIGHEST for action port [ 910.103387] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-99c26a15-b6fd-44ad-abdb-aec2b6a45b50 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.103550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99c26a15-b6fd-44ad-abdb-aec2b6a45b50" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.103550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99c26a15-b6fd-44ad-abdb-aec2b6a45b50" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.104065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99c26a15-b6fd-44ad-abdb-aec2b6a45b50" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.104151] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99c26a15-b6fd-44ad-abdb-aec2b6a45b50',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.488035] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: SUCCESS [ 910.488795] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.611419] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 99c26a15-b6fd-44ad-abdb-aec2b6a45b50 [ 910.611419] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.611419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.611419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.611419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.611419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.611419] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:99c26a15-b6fd-44ad-abdb-aec2b6a45b50 already deleted. [ 910.611419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99c26a15-b6fd-44ad-abdb-aec2b6a45b50" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.779088] env[66519]: INFO networking_nsxv3.common.synchronization [req-cf671049-c409-49c4-ae32-eba3b59ceedd req-bdcf9a09-c7c7-4a58-a39d-a90c6d516a9a tempest-ServerRescueTestJSON-1068866122 tempest-ServerRescueTestJSON-1068866122-project-member] Enqueued Resource ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 with Priority: HIGHEST for action security_group_members [ 910.779088] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 with Priority: HIGHEST for action security_group_members [ 910.779586] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.780527] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.780901] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.781151] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.781398] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.781537] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.781604] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.781794] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.781942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.782011] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.227788] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-11 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.228301] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-11" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.228301] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-11" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.229136] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-11" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.229477] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.229641] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.230212] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.230212] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.230338] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.230477] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 911.230586] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 911.230688] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 911.230805] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 911.230941] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 911.231097] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 911.231360] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 911.256998] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 911.257286] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 911.257477] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 911.257663] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-11" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.258091] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-a525bee3-d4d8-48d7-b27a-f77bcd2804bf taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.258252] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-a525bee3-d4d8-48d7-b27a-f77bcd2804bf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.258529] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-a525bee3-d4d8-48d7-b27a-f77bcd2804bf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.259574] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-a525bee3-d4d8-48d7-b27a-f77bcd2804bf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.259574] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a525bee3-d4d8-48d7-b27a-f77bcd2804bf',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.285613] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.761935] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.762194] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.762323] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.762601] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.762761] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.762898] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port a525bee3-d4d8-48d7-b27a-f77bcd2804bf not found, creating... [ 911.763180] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.763978] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.763978] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.763978] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.763978] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.764117] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.764206] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.764320] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.764663] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.764663] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.764852] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: a525bee3-d4d8-48d7-b27a-f77bcd2804bf is going to be created. [ 911.786561] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.786832] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.786971] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.787316] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.787757] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.787868] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-a525bee3-d4d8-48d7-b27a-f77bcd2804bf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.788675] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.293111] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.293399] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.293399] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.293600] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.293691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.293822] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 is going to be updated. [ 912.335084] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.335235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.335305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.335512] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.335752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.345811] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 in Status: IN_PROGRESS for 2s [ 912.550137] env[66519]: INFO networking_nsxv3.common.synchronization [req-cf671049-c409-49c4-ae32-eba3b59ceedd req-67cc8c57-78e5-4b71-a3dc-2cca2c5e8b1d service nova] Enqueued Resource ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 with Priority: HIGHEST for action security_group_rules [ 912.550447] env[66519]: INFO networking_nsxv3.common.synchronization [req-cf671049-c409-49c4-ae32-eba3b59ceedd req-67cc8c57-78e5-4b71-a3dc-2cca2c5e8b1d service nova] Enqueued Resource ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 with Priority: HIGHEST for action security_group_members [ 912.550833] env[66519]: INFO networking_nsxv3.common.synchronization [req-cf671049-c409-49c4-ae32-eba3b59ceedd req-67cc8c57-78e5-4b71-a3dc-2cca2c5e8b1d service nova] Enqueued Resource ID: a525bee3-d4d8-48d7-b27a-f77bcd2804bf with Priority: HIGHEST for action port [ 912.551183] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 with Priority: HIGHEST for action security_group_rules [ 912.551399] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 with Priority: HIGHEST for action security_group_members [ 912.551511] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a525bee3-d4d8-48d7-b27a-f77bcd2804bf with Priority: HIGHEST for action port [ 912.553284] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.553412] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.553475] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.553685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.554869] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.558680] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.560248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.560248] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-a525bee3-d4d8-48d7-b27a-f77bcd2804bf taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.560248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a525bee3-d4d8-48d7-b27a-f77bcd2804bf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.560248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a525bee3-d4d8-48d7-b27a-f77bcd2804bf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.560248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a525bee3-d4d8-48d7-b27a-f77bcd2804bf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.560248] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a525bee3-d4d8-48d7-b27a-f77bcd2804bf',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.979937] env[66519]: INFO networking_nsxv3.common.synchronization [req-bef6018b-1c99-412d-9954-79fdfe9190bd req-ac8d78e1-a967-4249-951a-8842631db300 tempest-ServerActionsTestJSON-1487893254 tempest-ServerActionsTestJSON-1487893254-project-member] Enqueued Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_members [ 912.980598] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_members [ 912.981926] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.983163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.983252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.983526] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.983832] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.983832] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.983940] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.984041] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.984124] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.984217] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.063259] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.063420] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.068056] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a525bee3-d4d8-48d7-b27a-f77bcd2804bf with status ACTIVE [ 913.068056] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.068056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.068991] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.069183] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.069310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.069521] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.069623] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.069683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.069855] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.070218] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.071441] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.071441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.071441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.071441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.071441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.071441] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a525bee3-d4d8-48d7-b27a-f77bcd2804bf is going to be updated. [ 913.098256] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.099394] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.099585] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.099705] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.100700] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.101043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a525bee3-d4d8-48d7-b27a-f77bcd2804bf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.410072] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.410072] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.410072] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.412839] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.413371] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.416080] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.416080] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.416080] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.416080] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.416080] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.416080] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.416080] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.416080] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.416080] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.416080] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.416080] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.442807] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.445043] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 913.445043] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.445043] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.445043] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-aa8b0877-9ef0-4a1e-8728-ad2ebbcd5cd0 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.445043] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-aa8b0877-9ef0-4a1e-8728-ad2ebbcd5cd0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.445043] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-aa8b0877-9ef0-4a1e-8728-ad2ebbcd5cd0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.445582] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-aa8b0877-9ef0-4a1e-8728-ad2ebbcd5cd0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.445867] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa8b0877-9ef0-4a1e-8728-ad2ebbcd5cd0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.488624] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.488624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.488624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.488624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.488624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.488624] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.488624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.488624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.488624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.488624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.488624] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb already deleted. [ 913.488624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.814803] env[66519]: INFO networking_nsxv3.common.synchronization [None req-b3362f06-1ca5-45a6-9e2d-a2c91480bb22 None None] Enqueued Resource ID: 0a7423f9-4242-4fd8-a410-46956b7f8ffc with Priority: HIGHEST for action port [ 913.814803] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7423f9-4242-4fd8-a410-46956b7f8ffc with Priority: HIGHEST for action port [ 913.814803] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a7423f9-4242-4fd8-a410-46956b7f8ffc taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.814803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a7423f9-4242-4fd8-a410-46956b7f8ffc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.814803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a7423f9-4242-4fd8-a410-46956b7f8ffc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.815098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a7423f9-4242-4fd8-a410-46956b7f8ffc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.815098] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a7423f9-4242-4fd8-a410-46956b7f8ffc',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.949433] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.949433] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.949609] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.949914] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.950113] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.950451] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port aa8b0877-9ef0-4a1e-8728-ad2ebbcd5cd0 not found, creating... [ 913.950610] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.950802] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.950998] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.951268] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.951483] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.951785] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.951979] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.952119] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.952362] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.952525] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.952666] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: aa8b0877-9ef0-4a1e-8728-ad2ebbcd5cd0 is going to be created. [ 913.975431] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.975431] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.975431] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.975431] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.975794] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.975893] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-aa8b0877-9ef0-4a1e-8728-ad2ebbcd5cd0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.317262] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a7423f9-4242-4fd8-a410-46956b7f8ffc [ 914.317655] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.317655] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.317841] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.318108] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.319018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.319018] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a7423f9-4242-4fd8-a410-46956b7f8ffc already deleted. [ 914.319018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a7423f9-4242-4fd8-a410-46956b7f8ffc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.357176] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 in Status: SUCCESS [ 914.357495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.358354] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.358354] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.358354] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.358840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.358840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.358840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.359029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.359029] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.726727] env[66519]: INFO networking_nsxv3.common.synchronization [req-bef6018b-1c99-412d-9954-79fdfe9190bd req-3c8c2dab-6de1-484f-866c-4ad96a03c5c9 service nova] Enqueued Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_rules [ 914.727114] env[66519]: INFO networking_nsxv3.common.synchronization [req-bef6018b-1c99-412d-9954-79fdfe9190bd req-3c8c2dab-6de1-484f-866c-4ad96a03c5c9 service nova] Enqueued Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_members [ 914.727336] env[66519]: INFO networking_nsxv3.common.synchronization [req-bef6018b-1c99-412d-9954-79fdfe9190bd req-3c8c2dab-6de1-484f-866c-4ad96a03c5c9 service nova] Enqueued Resource ID: aa8b0877-9ef0-4a1e-8728-ad2ebbcd5cd0 with Priority: HIGHEST for action port [ 914.728600] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_rules [ 914.729614] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_members [ 914.729724] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa8b0877-9ef0-4a1e-8728-ad2ebbcd5cd0 with Priority: HIGHEST for action port [ 914.730110] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.730321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.730559] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.731026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.731026] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.732174] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.733316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.733316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.733316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.733316] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.733316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.733316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.733681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.733681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.733681] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.737225] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa8b0877-9ef0-4a1e-8728-ad2ebbcd5cd0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.737225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa8b0877-9ef0-4a1e-8728-ad2ebbcd5cd0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.737225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa8b0877-9ef0-4a1e-8728-ad2ebbcd5cd0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.737225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa8b0877-9ef0-4a1e-8728-ad2ebbcd5cd0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.737225] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa8b0877-9ef0-4a1e-8728-ad2ebbcd5cd0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.862897] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.240228] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.241325] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.241443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.241580] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa8b0877-9ef0-4a1e-8728-ad2ebbcd5cd0 with status ACTIVE [ 915.241732] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.241837] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.241892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.242124] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.242215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.242388] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.242482] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.242539] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.242691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.242765] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.242942] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.243690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.243829] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.244336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.244336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.244336] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa8b0877-9ef0-4a1e-8728-ad2ebbcd5cd0 is going to be updated. [ 915.272419] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.272582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.272645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.272968] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.273268] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.273356] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa8b0877-9ef0-4a1e-8728-ad2ebbcd5cd0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.365719] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.748069] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.870676] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.870973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.870973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.871716] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.871858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.871987] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 is going to be updated. [ 915.929118] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.929395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.930271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.930271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.930271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.950139] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 in Status: IN_PROGRESS for 2s [ 916.251404] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.251680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.251778] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.252125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.252311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.252311] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb is going to be created. [ 916.321234] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.321525] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.321525] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.322204] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.322204] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.338282] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: UNINITIALIZED for 2s [ 917.465867] env[66519]: INFO networking_nsxv3.common.synchronization [req-19a3bb8f-cc8b-4019-b1ff-fc0ac5b07b0f req-8ebc664f-dbdd-4b0d-ba90-92afca187ec9 tempest-ImagesOneServerNegativeTestJSON-1631615325 tempest-ImagesOneServerNegativeTestJSON-1631615325-project-member] Enqueued Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_members [ 917.466493] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9ed5e58-fb42-4430-8674-e9d732009460 with Priority: HIGHEST for action security_group_members [ 917.466889] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9ed5e58-fb42-4430-8674-e9d732009460 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.467299] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.467399] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.467624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.467868] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.467983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.468053] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.468206] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.468291] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.468384] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9ed5e58-fb42-4430-8674-e9d732009460',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.962493] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 in Status: SUCCESS [ 917.962738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.963378] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.963674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.963894] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.964051] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.964126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.964286] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.964369] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.964550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.964641] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.971722] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.971927] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.972480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.972480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.972480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.972764] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.972952] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.973835] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.973835] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.973835] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.973835] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ed5e58-fb42-4430-8674-e9d732009460 is going to be updated. [ 918.005932] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.006088] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.006165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.006361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.006506] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.017687] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: IN_PROGRESS for 2s [ 918.354051] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: SUCCESS [ 918.354382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.354617] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.354999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.355279] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.355655] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.355752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.355911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.356012] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.357917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.357917] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.467099] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.467687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.467687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.467687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.467964] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.467964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.467964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.468191] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.468264] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.468428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.468515] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.468667] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.468786] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.468948] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.469171] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.469302] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.469418] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.469602] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.469691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.469867] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.469989] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.858887] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.972617] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9: rpc.has_security_group_logging(os_id): False [ 919.007673] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.007673] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.007673] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.007673] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.007673] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.007673] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.007673] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.008404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.008404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.008404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.008404] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.008404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.008573] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.008666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.008666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.009049] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.009049] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.009049] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.009236] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.009297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.009371] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 is going to be updated. [ 919.102614] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.102812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.102860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.103088] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.103234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.118150] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 in Status: IN_PROGRESS for 2s [ 919.362013] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78ee5c7f-abf9-47ad-98da-200bfacc0aeb: rpc.has_security_group_logging(os_id): False [ 919.386281] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.386536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.386536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.386623] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.387838] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.387838] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.387838] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.387838] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.387838] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.387838] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.387838] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb is going to be created. [ 919.464926] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.465268] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.465425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.465805] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.466210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.493292] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: IN_PROGRESS for 2s [ 920.030915] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9ed5e58-fb42-4430-8674-e9d732009460 in Status: SUCCESS [ 920.030915] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9ed5e58-fb42-4430-8674-e9d732009460 deletion is rescheduled due to dependency. [ 920.030915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9ed5e58-fb42-4430-8674-e9d732009460" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.170977] env[66519]: INFO networking_nsxv3.common.synchronization [req-9c986b15-95f2-43a4-88d0-2506d3eb0a1d req-dfe09510-760d-4f42-a05e-6be732f035a9 tempest-ServerActionsTestOtherA-1261634680 tempest-ServerActionsTestOtherA-1261634680-project-member] Enqueued Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGHEST for action security_group_members [ 920.171499] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGHEST for action security_group_members [ 920.174314] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.174453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.174529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.174853] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.175911] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.176133] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.176249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.176482] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.176678] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.176847] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e8b7135-b92c-4b10-aa25-eb568bfe0ab7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.574602] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-320 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.574945] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.574945] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.575831] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.575831] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.575831] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.575831] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.576060] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.584266] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.584678] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 920.584843] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 920.584966] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 920.585093] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 920.585347] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 920.585347] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 920.585462] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 920.609364] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 920.609364] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 920.609364] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 920.609364] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.609617] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-c825e439-1adc-4493-991a-e13b67715a6b taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.609817] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-c825e439-1adc-4493-991a-e13b67715a6b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.609949] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-c825e439-1adc-4493-991a-e13b67715a6b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.610300] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-c825e439-1adc-4493-991a-e13b67715a6b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.610441] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c825e439-1adc-4493-991a-e13b67715a6b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.680880] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.681416] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.681416] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.681558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.681621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.681850] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.681981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.682065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.682259] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.682339] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.682443] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 already deleted. [ 920.682534] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.115667] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.116093] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.116352] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.116852] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.117075] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.117285] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port c825e439-1adc-4493-991a-e13b67715a6b not found, creating... [ 921.117606] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.117810] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.117924] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.118205] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.118340] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.118659] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.118868] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.119082] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.119443] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.119656] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.119893] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: c825e439-1adc-4493-991a-e13b67715a6b is going to be created. [ 921.146079] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 in Status: SUCCESS [ 921.146079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.157487] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.157972] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.158149] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.158592] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.158900] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.159178] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-c825e439-1adc-4493-991a-e13b67715a6b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.511403] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: SUCCESS [ 921.511403] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.897385] env[66519]: INFO networking_nsxv3.common.synchronization [req-9c986b15-95f2-43a4-88d0-2506d3eb0a1d req-25393e1b-fa01-4ed4-a0ba-9e1b44660127 service nova] Enqueued Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGHEST for action security_group_rules [ 921.897385] env[66519]: INFO networking_nsxv3.common.synchronization [req-9c986b15-95f2-43a4-88d0-2506d3eb0a1d req-25393e1b-fa01-4ed4-a0ba-9e1b44660127 service nova] Enqueued Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGHEST for action security_group_members [ 921.897385] env[66519]: INFO networking_nsxv3.common.synchronization [req-9c986b15-95f2-43a4-88d0-2506d3eb0a1d req-25393e1b-fa01-4ed4-a0ba-9e1b44660127 service nova] Enqueued Resource ID: c825e439-1adc-4493-991a-e13b67715a6b with Priority: HIGHEST for action port [ 921.898191] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGHEST for action security_group_rules [ 921.898332] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGHEST for action security_group_members [ 921.898432] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c825e439-1adc-4493-991a-e13b67715a6b with Priority: HIGHEST for action port [ 921.898778] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.898877] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.898877] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.899150] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.899236] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e8b7135-b92c-4b10-aa25-eb568bfe0ab7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.900639] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.900778] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.900821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.900997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.901162] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.901257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.901319] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.901457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.901540] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.901624] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e8b7135-b92c-4b10-aa25-eb568bfe0ab7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.902387] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-c825e439-1adc-4493-991a-e13b67715a6b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.902499] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c825e439-1adc-4493-991a-e13b67715a6b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.902549] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c825e439-1adc-4493-991a-e13b67715a6b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.902691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c825e439-1adc-4493-991a-e13b67715a6b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.902761] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c825e439-1adc-4493-991a-e13b67715a6b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.937869] env[66519]: INFO networking_nsxv3.common.synchronization [req-b9e09abb-3740-49ee-8f24-7cc702d61a88 req-a5d892b5-13af-4f03-89a5-b90f13fbb410 tempest-AttachVolumeShelveTestJSON-264753527 tempest-AttachVolumeShelveTestJSON-264753527-project-member] Enqueued Resource ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 with Priority: HIGHEST for action security_group_members [ 921.938306] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 with Priority: HIGHEST for action security_group_members [ 921.938572] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.938692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.938755] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.938958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.939155] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.939296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.939296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.940295] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.940295] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.940295] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb3bbf89-6cbf-4b9e-b793-607035a2d9c3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.404429] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e8b7135-b92c-4b10-aa25-eb568bfe0ab7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.405694] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.405835] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.406028] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c825e439-1adc-4493-991a-e13b67715a6b with status ACTIVE [ 922.406224] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.406359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.406425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.406673] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.406782] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.406978] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.407215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.409056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.409056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.409056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.409056] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.409056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.409056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.409056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.409056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.409056] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c825e439-1adc-4493-991a-e13b67715a6b is going to be updated. [ 922.431859] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.431859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.431859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.432109] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.432109] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.432263] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c825e439-1adc-4493-991a-e13b67715a6b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.442189] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.442329] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.442399] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.442605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.442695] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.442892] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.443045] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.443100] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.443219] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.443293] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.443379] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 is going to be updated. [ 922.476867] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.477303] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.477303] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.477417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.477527] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.490375] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 in Status: IN_PROGRESS for 2s [ 922.912066] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e8b7135-b92c-4b10-aa25-eb568bfe0ab7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.929063] env[66519]: INFO networking_nsxv3.common.synchronization [req-4760e150-f83a-4f27-b6f6-7059465c20f9 req-95d0fc9b-a859-4b4e-b4d1-7e3436d39690 tempest-ServersTestManualDisk-1887932989 tempest-ServersTestManualDisk-1887932989-project-member] Enqueued Resource ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 with Priority: HIGHEST for action security_group_members [ 922.929732] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 with Priority: HIGHEST for action security_group_members [ 922.930640] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.930767] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.930839] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.931111] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.931520] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.931520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.931520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.931664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.931664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.931738] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb0f115b-2ae8-4ea8-bf0a-99edddaaee58',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.247042] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-540 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.247274] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-540" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.247396] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-540" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.247730] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-540" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.248331] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.248331] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.248505] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.248568] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.248714] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.248918] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.249040] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 923.249184] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 923.249287] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 923.249401] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.249503] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 923.249634] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 923.278347] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 923.278512] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 923.278648] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 923.278823] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-540" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.279175] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-d9c96986-f140-4058-960b-565cb10b4bf9 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.279364] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-d9c96986-f140-4058-960b-565cb10b4bf9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.279483] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-d9c96986-f140-4058-960b-565cb10b4bf9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.280699] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-d9c96986-f140-4058-960b-565cb10b4bf9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.280699] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9c96986-f140-4058-960b-565cb10b4bf9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.413377] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.415777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.415777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.415777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.415777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.415777] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 is going to be created. [ 923.433820] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.434241] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.434407] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.434695] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.435713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.435713] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.435713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.435713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.435713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.435713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.435713] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 already deleted. [ 923.435713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.443288] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.443288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.443288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.443288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.443288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.454995] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 in Status: UNINITIALIZED for 2s [ 923.783323] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.783561] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.783688] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.783972] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.784157] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.784317] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port d9c96986-f140-4058-960b-565cb10b4bf9 not found, creating... [ 923.784589] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.784757] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.784875] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.785113] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.785248] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.785524] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.785674] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.785789] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.785992] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.786131] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.786270] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: d9c96986-f140-4058-960b-565cb10b4bf9 is going to be created. [ 923.809179] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.809515] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.809557] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.809919] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.810190] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.810471] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-d9c96986-f140-4058-960b-565cb10b4bf9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.504952] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 in Status: SUCCESS [ 924.505395] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb3bbf89-6cbf-4b9e-b793-607035a2d9c3 deletion is rescheduled due to dependency. [ 924.505395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb3bbf89-6cbf-4b9e-b793-607035a2d9c3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.568848] env[66519]: INFO networking_nsxv3.common.synchronization [req-4760e150-f83a-4f27-b6f6-7059465c20f9 req-5179442e-5042-4526-b6b3-0815fab645a4 service nova] Enqueued Resource ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 with Priority: HIGHEST for action security_group_rules [ 924.569129] env[66519]: INFO networking_nsxv3.common.synchronization [req-4760e150-f83a-4f27-b6f6-7059465c20f9 req-5179442e-5042-4526-b6b3-0815fab645a4 service nova] Enqueued Resource ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 with Priority: HIGHEST for action security_group_members [ 924.569129] env[66519]: INFO networking_nsxv3.common.synchronization [req-4760e150-f83a-4f27-b6f6-7059465c20f9 req-5179442e-5042-4526-b6b3-0815fab645a4 service nova] Enqueued Resource ID: d9c96986-f140-4058-960b-565cb10b4bf9 with Priority: HIGHEST for action port [ 924.569896] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 with Priority: HIGHEST for action security_group_rules [ 924.570128] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 with Priority: HIGHEST for action security_group_members [ 924.570256] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9c96986-f140-4058-960b-565cb10b4bf9 with Priority: HIGHEST for action port [ 924.570648] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.570819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.570917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.571222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.571340] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb0f115b-2ae8-4ea8-bf0a-99edddaaee58',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.572788] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.572951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.573093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.573315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.573578] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.573723] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.573819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.574509] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.574509] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.574509] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb0f115b-2ae8-4ea8-bf0a-99edddaaee58',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.576052] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9c96986-f140-4058-960b-565cb10b4bf9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.576267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9c96986-f140-4058-960b-565cb10b4bf9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.576350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9c96986-f140-4058-960b-565cb10b4bf9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.576682] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9c96986-f140-4058-960b-565cb10b4bf9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.576682] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9c96986-f140-4058-960b-565cb10b4bf9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.079417] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.079417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.079717] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb0f115b-2ae8-4ea8-bf0a-99edddaaee58',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.080669] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9c96986-f140-4058-960b-565cb10b4bf9 with status ACTIVE [ 925.080957] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.081157] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.081271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.081570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.081702] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.082476] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.083754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.083754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.083754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.083754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.084079] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.084079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.084079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.084300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.084300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.084364] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9c96986-f140-4058-960b-565cb10b4bf9 is going to be updated. [ 925.133422] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.133619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.133674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.133883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.134051] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.134231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9c96986-f140-4058-960b-565cb10b4bf9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.468220] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 in Status: SUCCESS [ 925.468412] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.468600] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.469046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.469046] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.469234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.469234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.469371] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.469495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.469587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.469678] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e8b7135-b92c-4b10-aa25-eb568bfe0ab7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.588358] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb0f115b-2ae8-4ea8-bf0a-99edddaaee58',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.972396] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.972574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.972626] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.972867] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.973051] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.973158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.973220] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.973383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.973601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.973601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.973699] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.973802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.973853] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.974020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.974180] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.974273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.974348] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.974470] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.974545] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.974626] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.974749] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e8b7135-b92c-4b10-aa25-eb568bfe0ab7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.092550] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.092550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.092550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.092550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.092550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.092550] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 is going to be created. [ 926.125147] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.125147] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.125147] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.125315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.125354] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.137683] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 in Status: UNINITIALIZED for 2s [ 926.479500] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7: rpc.has_security_group_logging(os_id): False [ 926.505070] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.506409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.506557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.507440] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.507440] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.509271] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.509481] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.509596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.509881] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.510052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.510500] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.510724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.513202] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.513530] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.513626] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.514267] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.514267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.514267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.514267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.514609] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.514609] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 is going to be created. [ 926.600100] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.600526] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.600526] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.600648] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.600797] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.617978] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 in Status: IN_PROGRESS for 2s [ 926.964860] env[66519]: INFO networking_nsxv3.common.synchronization [req-4a839f5b-c2b8-4b9e-9b39-afae2f194725 req-12a0a42a-ae17-4879-bdb3-3727329d098d tempest-MigrationsAdminTest-1659008040 tempest-MigrationsAdminTest-1659008040-project-member] Enqueued Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGHEST for action security_group_members [ 926.965397] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGHEST for action security_group_members [ 926.968826] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.968826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.968826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.968826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.968826] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.968826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.968826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.968826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.968826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.968826] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.470953] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.471159] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.471232] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.471449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.471660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.471729] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.471823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.471884] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.472048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.472126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.472210] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cb7c090-e083-487a-aa5d-420200af9bce is going to be updated. [ 927.503374] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.503594] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.503594] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.503806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.504019] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.513548] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cb7c090-e083-487a-aa5d-420200af9bce in Status: IN_PROGRESS for 2s [ 928.148020] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 in Status: SUCCESS [ 928.148388] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.148612] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.148925] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.149412] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.150334] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.150334] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.150470] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.150654] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.150725] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.150909] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb0f115b-2ae8-4ea8-bf0a-99edddaaee58',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.638083] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 in Status: SUCCESS [ 928.638083] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.653947] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb0f115b-2ae8-4ea8-bf0a-99edddaaee58',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.157638] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb0f115b-2ae8-4ea8-bf0a-99edddaaee58: rpc.has_security_group_logging(os_id): False [ 929.177122] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.177261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.177594] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.177594] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.177695] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.177880] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.177967] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.178058] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.178598] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.178598] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.178598] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 is going to be created. [ 929.247033] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.247297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.247351] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.247825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.247927] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.260333] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 in Status: IN_PROGRESS for 2s [ 929.532242] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6cb7c090-e083-487a-aa5d-420200af9bce in Status: SUCCESS [ 929.534133] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6cb7c090-e083-487a-aa5d-420200af9bce deletion is rescheduled due to dependency. [ 929.534432] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.276039] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 in Status: SUCCESS [ 931.276039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.966797] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 931.966978] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 932.549647] env[66519]: INFO networking_nsxv3.common.synchronization [None req-230954c5-188b-4167-b260-7838d868b5c9 None None] Enqueued Resource ID: 1754235c-c84d-4040-8b14-a7beedd67e92 with Priority: HIGHEST for action port [ 932.550306] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1754235c-c84d-4040-8b14-a7beedd67e92 with Priority: HIGHEST for action port [ 932.550656] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-1754235c-c84d-4040-8b14-a7beedd67e92 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.550782] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1754235c-c84d-4040-8b14-a7beedd67e92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.550850] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1754235c-c84d-4040-8b14-a7beedd67e92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.551122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1754235c-c84d-4040-8b14-a7beedd67e92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.551209] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1754235c-c84d-4040-8b14-a7beedd67e92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.053886] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1754235c-c84d-4040-8b14-a7beedd67e92 [ 933.054160] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.054290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.054358] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.054567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.054654] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.054805] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1754235c-c84d-4040-8b14-a7beedd67e92 already deleted. [ 933.054920] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1754235c-c84d-4040-8b14-a7beedd67e92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.475618] env[66519]: INFO networking_nsxv3.common.synchronization [req-4e2e83d7-bea2-4105-b084-1af56ac1b2f4 req-98b73ccf-1007-4650-bd1f-af181246a739 tempest-ServersNegativeTestJSON-375310877 tempest-ServersNegativeTestJSON-375310877-project-member] Enqueued Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_members [ 934.476807] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGHEST for action security_group_members [ 934.476994] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.477505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.477505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.477651] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.477901] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.478083] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.478264] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.478438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.478582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.478735] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.982332] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.982485] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.982554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.982776] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.982863] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.983102] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.983172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.983262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.983480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.983519] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.983579] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f825e83f-7046-4bbd-969b-a037ace80c92 is going to be updated. [ 934.991613] env[66519]: INFO networking_nsxv3.common.synchronization [None req-82ffeb08-625b-460d-9080-bd455eb18e8e None None] Enqueued Resource ID: 0d4cabb2-b7ef-4564-bd03-86f81472b34b with Priority: HIGHEST for action port [ 934.992259] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d4cabb2-b7ef-4564-bd03-86f81472b34b with Priority: HIGHEST for action port [ 934.994744] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d4cabb2-b7ef-4564-bd03-86f81472b34b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.994744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d4cabb2-b7ef-4564-bd03-86f81472b34b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.994744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d4cabb2-b7ef-4564-bd03-86f81472b34b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.994744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d4cabb2-b7ef-4564-bd03-86f81472b34b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.995178] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d4cabb2-b7ef-4564-bd03-86f81472b34b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.026085] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.026247] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.026320] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.026524] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.026669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.037790] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: IN_PROGRESS for 2s [ 935.497471] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d4cabb2-b7ef-4564-bd03-86f81472b34b [ 935.497819] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.497893] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.497999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.498237] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.498331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.498426] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d4cabb2-b7ef-4564-bd03-86f81472b34b already deleted. [ 935.498510] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d4cabb2-b7ef-4564-bd03-86f81472b34b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.053152] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f825e83f-7046-4bbd-969b-a037ace80c92 in Status: SUCCESS [ 937.053626] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f825e83f-7046-4bbd-969b-a037ace80c92 deletion is rescheduled due to dependency. [ 937.054307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.855662] env[66519]: INFO networking_nsxv3.common.synchronization [req-bbbdc218-3a05-4866-ac9e-e17511656f74 req-330043d4-e0d1-4ce2-aaca-c4f648349cd9 tempest-ServerRescueTestJSONUnderV235-343565798 tempest-ServerRescueTestJSONUnderV235-343565798-project-member] Enqueued Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_members [ 939.856259] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_members [ 939.856584] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d11ddda-ea1f-4e83-8a8e-a42a470af616 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.856703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.856770] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.857073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.857258] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.857366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.857470] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.857616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.857689] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.857805] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.220440] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-32 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.220918] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-32" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.221076] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-32" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.221412] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-32" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.221769] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.223590] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.223723] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.223978] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.224149] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.224366] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.224510] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 940.224644] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 940.224756] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 940.224870] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 940.224978] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 940.225134] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 940.259589] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 940.259719] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 940.259877] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 940.260115] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-32" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.260886] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-74818530-aa74-4d97-be24-73ccada63434 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.260886] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-74818530-aa74-4d97-be24-73ccada63434" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.261067] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-74818530-aa74-4d97-be24-73ccada63434" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.261414] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-74818530-aa74-4d97-be24-73ccada63434" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.261452] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74818530-aa74-4d97-be24-73ccada63434',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.360543] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.360707] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.360782] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.361014] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.361115] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.361310] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.361434] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.361528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.361710] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.361787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.361874] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 already deleted. [ 940.361955] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.479955] env[66519]: INFO networking_nsxv3.common.synchronization [req-84622982-2436-41db-8fa1-61d68fcb9246 req-aa629f6d-f848-4f37-9a9e-36d37750c2c1 tempest-ServerRescueTestJSON-1068866122 tempest-ServerRescueTestJSON-1068866122-project-member] Enqueued Resource ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 with Priority: HIGHEST for action security_group_members [ 940.480602] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 with Priority: HIGHEST for action security_group_members [ 940.481096] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.481253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.481332] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.481606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.481806] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.481937] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.482034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.482281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.482390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.482534] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.764475] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.764758] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.764944] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.765246] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.765399] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.765552] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 74818530-aa74-4d97-be24-73ccada63434 not found, creating... [ 940.765836] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.766011] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.766143] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.766375] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.766550] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.766859] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.767187] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.767340] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.767573] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.767742] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.767880] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 74818530-aa74-4d97-be24-73ccada63434 is going to be created. [ 940.790502] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.790682] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.790745] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.791034] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.791333] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.791560] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-74818530-aa74-4d97-be24-73ccada63434" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.985915] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.489098] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.523787] env[66519]: INFO networking_nsxv3.common.synchronization [req-bbbdc218-3a05-4866-ac9e-e17511656f74 req-29eb73e4-616a-488a-88e8-4fc3b568d438 service nova] Enqueued Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_rules [ 941.523870] env[66519]: INFO networking_nsxv3.common.synchronization [req-bbbdc218-3a05-4866-ac9e-e17511656f74 req-29eb73e4-616a-488a-88e8-4fc3b568d438 service nova] Enqueued Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_members [ 941.523990] env[66519]: INFO networking_nsxv3.common.synchronization [req-bbbdc218-3a05-4866-ac9e-e17511656f74 req-29eb73e4-616a-488a-88e8-4fc3b568d438 service nova] Enqueued Resource ID: 74818530-aa74-4d97-be24-73ccada63434 with Priority: HIGHEST for action port [ 941.524507] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_rules [ 941.524643] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_members [ 941.524740] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74818530-aa74-4d97-be24-73ccada63434 with Priority: HIGHEST for action port [ 941.525142] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d11ddda-ea1f-4e83-8a8e-a42a470af616 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.525274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.525341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.525612] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.525697] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.527473] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d11ddda-ea1f-4e83-8a8e-a42a470af616 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.528402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.528402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.528402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.528402] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.528402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.528402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.528402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.528402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.528828] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.529335] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-74818530-aa74-4d97-be24-73ccada63434 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.529450] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74818530-aa74-4d97-be24-73ccada63434" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.529520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74818530-aa74-4d97-be24-73ccada63434" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.529677] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74818530-aa74-4d97-be24-73ccada63434" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.529759] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74818530-aa74-4d97-be24-73ccada63434',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.992325] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.992746] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.992746] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.993008] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.993164] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.993381] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 is going to be updated. [ 942.025599] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.028036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.028036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.028036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.028036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.031364] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d11ddda-ea1f-4e83-8a8e-a42a470af616 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.031557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.032843] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.032944] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74818530-aa74-4d97-be24-73ccada63434 with status ACTIVE [ 942.033978] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.033978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.033978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.034164] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.034824] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.034824] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.034824] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.034824] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.035126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.035126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.036172] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.036172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.036172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.036172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.036172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.036172] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74818530-aa74-4d97-be24-73ccada63434 is going to be updated. [ 942.040550] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 in Status: IN_PROGRESS for 2s [ 942.068465] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.068641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.068692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.069120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.069120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.069245] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74818530-aa74-4d97-be24-73ccada63434" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.315114] env[66519]: INFO networking_nsxv3.common.synchronization [req-fee8192f-fae6-48f8-b109-e152cfa19ac6 req-5efdf46a-3cef-442f-bd2f-b4c59adc7f3a tempest-ServersTestJSON-971253557 tempest-ServersTestJSON-971253557-project-member] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 942.315886] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 942.316412] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.316412] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.316546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.316670] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.316850] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.317216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.317216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.317338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.317475] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.317524] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.541294] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.702192] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-450 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.702414] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.702568] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.702876] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.703325] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.703497] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.703629] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.703874] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.704129] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.704490] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.704626] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.704758] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.704870] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.705016] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.705161] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.705365] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.728271] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.728271] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 942.728271] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.729039] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.729039] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-43782039-da54-456c-a45a-18b515019aab taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.729039] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-43782039-da54-456c-a45a-18b515019aab" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.729039] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-43782039-da54-456c-a45a-18b515019aab" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.729398] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-43782039-da54-456c-a45a-18b515019aab" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.729539] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43782039-da54-456c-a45a-18b515019aab',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.820998] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.043784] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.044188] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.044188] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.044257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.044305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.044393] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 is going to be created. [ 943.069184] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.069426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.069426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.069610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.069773] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.082022] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 in Status: UNINITIALIZED for 2s [ 943.232083] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.232350] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.232350] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.232765] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.233035] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.233278] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 43782039-da54-456c-a45a-18b515019aab not found, creating... [ 943.233600] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.233804] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.233934] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.234206] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.234375] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.234788] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.234973] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.235092] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.235321] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.235461] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.235601] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 43782039-da54-456c-a45a-18b515019aab is going to be created. [ 943.258828] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.259155] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.259304] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.259665] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.259904] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.260159] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-43782039-da54-456c-a45a-18b515019aab" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.323630] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.826633] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.827117] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.827117] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.827256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.827288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.827402] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 943.858371] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.858555] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.858642] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.859388] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.859388] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.870326] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 943.972798] env[66519]: INFO networking_nsxv3.common.synchronization [req-fee8192f-fae6-48f8-b109-e152cfa19ac6 req-42269948-d357-45e4-9f4e-3350c8e672ba service nova] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_rules [ 943.973111] env[66519]: INFO networking_nsxv3.common.synchronization [req-fee8192f-fae6-48f8-b109-e152cfa19ac6 req-42269948-d357-45e4-9f4e-3350c8e672ba service nova] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 943.973417] env[66519]: INFO networking_nsxv3.common.synchronization [req-fee8192f-fae6-48f8-b109-e152cfa19ac6 req-42269948-d357-45e4-9f4e-3350c8e672ba service nova] Enqueued Resource ID: 43782039-da54-456c-a45a-18b515019aab with Priority: HIGHEST for action port [ 943.974469] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_rules [ 943.974718] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 943.975042] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43782039-da54-456c-a45a-18b515019aab with Priority: HIGHEST for action port [ 943.975716] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.975716] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.975716] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.976025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.976025] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.976803] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.976916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.978591] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-43782039-da54-456c-a45a-18b515019aab taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.978591] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43782039-da54-456c-a45a-18b515019aab" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.978591] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43782039-da54-456c-a45a-18b515019aab" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.978591] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43782039-da54-456c-a45a-18b515019aab" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.978591] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43782039-da54-456c-a45a-18b515019aab',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.052025] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 in Status: SUCCESS [ 944.052025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.480188] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.480330] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.481681] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43782039-da54-456c-a45a-18b515019aab with status ACTIVE [ 944.483579] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.483579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.483579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.483579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.483579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.483579] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.483579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.483579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.483579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.483579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.483579] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.483579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.483579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.483579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.483579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.484351] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43782039-da54-456c-a45a-18b515019aab is going to be updated. [ 944.504579] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.505085] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.505430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.505502] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.505908] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.505908] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43782039-da54-456c-a45a-18b515019aab" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.053254] env[66519]: INFO networking_nsxv3.common.synchronization [req-bdc7717b-311a-4caf-a3e7-bc167515d9af req-8c7ec1d6-f336-4911-ab73-3d8b1b229699 tempest-ServersTestJSON-1970727514 tempest-ServersTestJSON-1970727514-project-member] Enqueued Resource ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 with Priority: HIGHEST for action security_group_members [ 945.054112] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 with Priority: HIGHEST for action security_group_members [ 945.054626] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.056020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.056020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.056020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.056020] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.056020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.056020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.056020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.056020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.056020] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.093586] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 in Status: SUCCESS [ 945.093586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.093769] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.094380] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.094380] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.094380] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.094380] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.094616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.094616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.094616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.094719] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.560674] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.560674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.560674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.560674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.560674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.560967] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.560967] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.561073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.561386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.561386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.561386] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 is going to be updated. [ 945.591957] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.591957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.591957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.591957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.592208] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.596729] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d11ddda-ea1f-4e83-8a8e-a42a470af616 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.596890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.597059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.597206] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.597374] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.597523] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.597563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.597752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.597878] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.598015] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.598214] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d11ddda-ea1f-4e83-8a8e-a42a470af616 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.598314] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.598467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.598531] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.598661] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.598762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.598810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.598974] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.599069] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.599177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.599282] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.602161] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 in Status: IN_PROGRESS for 2s [ 945.882209] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 945.882450] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.882797] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.882925] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.883157] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.883280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.883382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.883626] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.884351] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.884351] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.101692] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d11ddda-ea1f-4e83-8a8e-a42a470af616: rpc.has_security_group_logging(os_id): False [ 946.124198] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.124278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.124278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.124531] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.124631] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.124856] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.125018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.125084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.125262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.125353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.125524] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.125619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.125681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.125819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.125892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.126118] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.126226] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.126274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.126408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.126479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.126562] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 is going to be created. [ 946.205292] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.205484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.205671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.206061] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.206359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.227947] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 in Status: IN_PROGRESS for 2s [ 946.387526] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.891564] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.264166] env[66519]: INFO networking_nsxv3.common.synchronization [None req-5c7721fe-044c-43b9-909c-aa77a4285687 None None] Enqueued Resource ID: 611a3c31-9cac-471e-acee-b7a44fabe7ac with Priority: HIGHEST for action port [ 947.264166] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 611a3c31-9cac-471e-acee-b7a44fabe7ac with Priority: HIGHEST for action port [ 947.264166] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-611a3c31-9cac-471e-acee-b7a44fabe7ac taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.264166] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-611a3c31-9cac-471e-acee-b7a44fabe7ac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.264166] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-611a3c31-9cac-471e-acee-b7a44fabe7ac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.264166] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-611a3c31-9cac-471e-acee-b7a44fabe7ac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.264166] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('611a3c31-9cac-471e-acee-b7a44fabe7ac',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.395046] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.395046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.395046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.395046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.395046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.395046] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 947.422828] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.423231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.424062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.424062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.424062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.437412] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 947.613586] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 in Status: SUCCESS [ 947.614232] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 deletion is rescheduled due to dependency. [ 947.614232] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.753224] env[66519]: INFO networking_nsxv3.common.synchronization [None req-524e10c9-2eb1-440b-acd1-e74233d706c8 tempest-ServersTestFqdnHostnames-927688424 tempest-ServersTestFqdnHostnames-927688424-project-member] Enqueued Resource ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 with Priority: HIGHEST for action security_group_rules [ 947.753376] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 with Priority: HIGHEST for action security_group_rules [ 947.753702] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60c13785-2872-4af9-91d3-148ba8f8cc39 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.753860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.753926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.755384] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.755524] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60c13785-2872-4af9-91d3-148ba8f8cc39',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.765741] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 611a3c31-9cac-471e-acee-b7a44fabe7ac [ 947.766206] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.766349] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.766420] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.766631] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.766716] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.766810] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:611a3c31-9cac-471e-acee-b7a44fabe7ac already deleted. [ 947.766893] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-611a3c31-9cac-471e-acee-b7a44fabe7ac" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.848245] env[66519]: INFO networking_nsxv3.common.synchronization [None req-da2c923b-c8e5-4da8-80bd-e696df69f51d tempest-ServersTestFqdnHostnames-927688424 tempest-ServersTestFqdnHostnames-927688424-project-member] Enqueued Resource ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 with Priority: HIGHEST for action security_group_rules [ 947.848811] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 with Priority: HIGHEST for action security_group_rules [ 947.849397] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60c13785-2872-4af9-91d3-148ba8f8cc39 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.849397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.243264] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 in Status: SUCCESS [ 948.243264] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.294336] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.294336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.294336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.294336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.294336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.294336] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 already deleted. [ 948.294776] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.295028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.295251] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.295351] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60c13785-2872-4af9-91d3-148ba8f8cc39',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.821762] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.822025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.822142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.822345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.822481] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.822597] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 already deleted. [ 948.822697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.449187] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 949.449580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.449624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.449897] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.450141] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.450290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.450372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.450568] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.450661] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.450752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.450850] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.535869] env[66519]: INFO networking_nsxv3.common.synchronization [None req-3911a86e-cf34-4a91-9371-c1d6e432bdf9 None None] Enqueued Resource ID: 7c2d4da5-2b6e-454e-af90-180bf3487c9c with Priority: HIGHEST for action port [ 949.536548] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c2d4da5-2b6e-454e-af90-180bf3487c9c with Priority: HIGHEST for action port [ 949.537190] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c2d4da5-2b6e-454e-af90-180bf3487c9c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.537357] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c2d4da5-2b6e-454e-af90-180bf3487c9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.537447] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c2d4da5-2b6e-454e-af90-180bf3487c9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.537719] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c2d4da5-2b6e-454e-af90-180bf3487c9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.538011] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c2d4da5-2b6e-454e-af90-180bf3487c9c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.954581] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.954581] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.954581] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.954581] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.954581] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.954581] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.954581] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.954947] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.954947] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.954947] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.954947] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.955180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.955180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.955406] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.955467] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.955576] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.955610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.956592] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.956592] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.956592] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.956592] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.967158] env[66519]: INFO networking_nsxv3.common.synchronization [req-a315caae-4c5c-4e49-aa50-9eb84dfd29d1 req-9ce37497-5f22-4034-9879-401ba9e467dd tempest-ImagesTestJSON-1420515381 tempest-ImagesTestJSON-1420515381-project-member] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 949.967158] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 949.967680] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.967890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.967890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.969105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.969105] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.969105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.969105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.969105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.969105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.969105] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.041040] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c2d4da5-2b6e-454e-af90-180bf3487c9c [ 950.041192] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.041332] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.041398] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.041643] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.041737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.041842] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c2d4da5-2b6e-454e-af90-180bf3487c9c already deleted. [ 950.041939] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c2d4da5-2b6e-454e-af90-180bf3487c9c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.217954] env[66519]: INFO networking_nsxv3.common.synchronization [req-ecd817f4-e0c9-4461-9692-e3219b1b9ae7 req-3ef93322-0ac0-4e85-a570-e7b6418f1b12 tempest-ServerActionsTestOtherA-1261634680 tempest-ServerActionsTestOtherA-1261634680-project-member] Enqueued Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGHEST for action security_group_members [ 950.219051] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGHEST for action security_group_members [ 950.220198] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.220330] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.220447] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.220586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.220741] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.220867] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.221089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.221089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.221194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.221282] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e8b7135-b92c-4b10-aa25-eb568bfe0ab7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.460236] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb1cadf6-d26e-4714-b83e-0fcbe235e2e5: rpc.has_security_group_logging(os_id): False [ 950.471369] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.481339] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.481481] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.481558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.482049] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.482049] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.482160] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.482160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.482253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.482376] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.482451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.482633] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.482727] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.482785] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.482954] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.483039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.483197] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.483299] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.483356] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.483471] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.483539] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.483635] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 950.508136] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-161 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.508500] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.508719] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.509077] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.509395] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.509563] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.509717] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.509917] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.510054] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.510357] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 950.510513] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 950.510710] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 950.511445] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 950.511591] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 950.511735] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 950.511839] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 950.532313] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 950.532313] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 950.532313] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 950.532540] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.532850] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-82cac975-2470-4534-8771-9d1990d6eba5 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.533626] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-82cac975-2470-4534-8771-9d1990d6eba5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.533626] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-82cac975-2470-4534-8771-9d1990d6eba5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.533626] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-82cac975-2470-4534-8771-9d1990d6eba5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.533870] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82cac975-2470-4534-8771-9d1990d6eba5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.582106] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.582305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.582380] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.582594] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.582759] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.602413] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 950.724099] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.724267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.724371] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.724556] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.724651] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.724938] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.725115] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.725186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.725357] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.725426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.725517] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 is going to be updated. [ 950.760616] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.760892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.760951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.761204] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.762077] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.773145] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 in Status: IN_PROGRESS for 2s [ 950.974192] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.036370] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.036609] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.036721] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.037098] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.037298] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.037462] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 82cac975-2470-4534-8771-9d1990d6eba5 not found, creating... [ 951.037761] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.037925] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.038087] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.038332] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.038470] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.038761] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.038917] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.039042] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.039358] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.039458] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.039583] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 82cac975-2470-4534-8771-9d1990d6eba5 is going to be created. [ 951.066456] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.066673] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.066799] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.067189] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.067732] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.067732] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-82cac975-2470-4534-8771-9d1990d6eba5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.477197] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.477613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.477613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.477809] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.477945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.478097] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be updated. [ 951.516518] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.516691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.516768] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.517064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.517279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.527604] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: IN_PROGRESS for 2s [ 951.828629] env[66519]: INFO networking_nsxv3.common.synchronization [req-a315caae-4c5c-4e49-aa50-9eb84dfd29d1 req-219616bc-8d41-4285-b7a3-27e0f63ca39c service nova] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_rules [ 951.828850] env[66519]: INFO networking_nsxv3.common.synchronization [req-a315caae-4c5c-4e49-aa50-9eb84dfd29d1 req-219616bc-8d41-4285-b7a3-27e0f63ca39c service nova] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 951.828990] env[66519]: INFO networking_nsxv3.common.synchronization [req-a315caae-4c5c-4e49-aa50-9eb84dfd29d1 req-219616bc-8d41-4285-b7a3-27e0f63ca39c service nova] Enqueued Resource ID: 82cac975-2470-4534-8771-9d1990d6eba5 with Priority: HIGHEST for action port [ 951.829659] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_rules [ 951.829803] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 951.829924] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82cac975-2470-4534-8771-9d1990d6eba5 with Priority: HIGHEST for action port [ 951.830290] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.830441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.830521] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.830738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.830853] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.831760] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.831760] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.831960] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-82cac975-2470-4534-8771-9d1990d6eba5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.832064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82cac975-2470-4534-8771-9d1990d6eba5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.832161] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82cac975-2470-4534-8771-9d1990d6eba5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.832296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82cac975-2470-4534-8771-9d1990d6eba5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.832417] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82cac975-2470-4534-8771-9d1990d6eba5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.334508] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.335285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.336723] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82cac975-2470-4534-8771-9d1990d6eba5 with status ACTIVE [ 952.337277] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.339911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.339911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.339911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.339911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.339911] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.339911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.339911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.339911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.339911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.339911] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.339911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.339911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.339911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.339911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.339911] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82cac975-2470-4534-8771-9d1990d6eba5 is going to be updated. [ 952.366663] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.366846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.367083] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.367210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.367361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.367545] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82cac975-2470-4534-8771-9d1990d6eba5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.618391] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 952.618937] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.748071] env[66519]: INFO networking_nsxv3.common.synchronization [None req-a7a870f3-96c1-4e0e-9502-397e27bea68a tempest-AttachVolumeShelveTestJSON-264753527 tempest-AttachVolumeShelveTestJSON-264753527-project-member] Enqueued Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGHEST for action security_group_rules [ 952.748803] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGHEST for action security_group_rules [ 952.749093] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.749227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.749322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.749665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.749665] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.787044] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 in Status: SUCCESS [ 952.787044] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 deletion is rescheduled due to dependency. [ 952.787044] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.015142] env[66519]: INFO networking_nsxv3.common.synchronization [None req-707dfd0a-a0c4-4678-9391-4a36b792ddcf tempest-AttachVolumeShelveTestJSON-264753527 tempest-AttachVolumeShelveTestJSON-264753527-project-member] Enqueued Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGHEST for action security_group_rules [ 953.015142] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGHEST for action security_group_rules [ 953.015142] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.015142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.271466] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.272300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.272300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.272300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.272300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.272300] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b already deleted. [ 953.272512] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.272512] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.272665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.272796] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.542035] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: SUCCESS [ 953.542035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.542035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.542035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.542035] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.542035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.542035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.542035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.542035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.542035] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.793216] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.795079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.795079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.795079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.795079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.795079] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b already deleted. [ 953.795079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.005638] env[66519]: INFO networking_nsxv3.common.synchronization [None req-ef139afe-3315-4a23-8c64-1fabca9e82ec None None] Enqueued Resource ID: ba8fc720-445c-49f8-bfda-54fda3d9070b with Priority: HIGHEST for action port [ 954.006169] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba8fc720-445c-49f8-bfda-54fda3d9070b with Priority: HIGHEST for action port [ 954.006485] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba8fc720-445c-49f8-bfda-54fda3d9070b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.006618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba8fc720-445c-49f8-bfda-54fda3d9070b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.006672] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba8fc720-445c-49f8-bfda-54fda3d9070b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.006934] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba8fc720-445c-49f8-bfda-54fda3d9070b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.009793] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba8fc720-445c-49f8-bfda-54fda3d9070b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.045561] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.514356] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba8fc720-445c-49f8-bfda-54fda3d9070b [ 954.514885] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.514885] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.515012] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.516552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.516552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.516552] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba8fc720-445c-49f8-bfda-54fda3d9070b already deleted. [ 954.516552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba8fc720-445c-49f8-bfda-54fda3d9070b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.550428] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.056289] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.056621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.056621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.056760] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.056818] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.056905] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be updated. [ 955.085818] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.085964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.086047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.086503] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.086882] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.099550] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: IN_PROGRESS for 2s [ 957.094300] env[66519]: INFO networking_nsxv3.common.synchronization [None req-9b71d39c-e494-4d9f-9c92-44a147745aef None None] Enqueued Resource ID: 5d68d5a3-bc6c-4e1b-ba31-c8d967587fde with Priority: HIGHEST for action port [ 957.094300] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d68d5a3-bc6c-4e1b-ba31-c8d967587fde with Priority: HIGHEST for action port [ 957.095565] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d68d5a3-bc6c-4e1b-ba31-c8d967587fde taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.095565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d68d5a3-bc6c-4e1b-ba31-c8d967587fde" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.095565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d68d5a3-bc6c-4e1b-ba31-c8d967587fde" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.096938] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d68d5a3-bc6c-4e1b-ba31-c8d967587fde" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.096938] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d68d5a3-bc6c-4e1b-ba31-c8d967587fde',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.114350] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: SUCCESS [ 957.114350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.114350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.114742] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.114742] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.115234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.115234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.115234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.115234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.115234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.115439] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.521245] env[66519]: INFO networking_nsxv3.common.synchronization [None req-ab497ab7-833a-463a-9113-f79761f83a81 None None] Enqueued Resource ID: 3cb96f49-e1ce-4f04-bd15-5f3cbd823cb0 with Priority: HIGHEST for action port [ 957.521805] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb96f49-e1ce-4f04-bd15-5f3cbd823cb0 with Priority: HIGHEST for action port [ 957.522206] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cb96f49-e1ce-4f04-bd15-5f3cbd823cb0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.522328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cb96f49-e1ce-4f04-bd15-5f3cbd823cb0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.522461] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cb96f49-e1ce-4f04-bd15-5f3cbd823cb0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.522637] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cb96f49-e1ce-4f04-bd15-5f3cbd823cb0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.522715] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cb96f49-e1ce-4f04-bd15-5f3cbd823cb0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.602250] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d68d5a3-bc6c-4e1b-ba31-c8d967587fde [ 957.602457] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.602609] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.602682] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.603243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.603338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.603440] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d68d5a3-bc6c-4e1b-ba31-c8d967587fde already deleted. [ 957.603516] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d68d5a3-bc6c-4e1b-ba31-c8d967587fde" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.618997] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.619186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.619273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.619500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.619670] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.619815] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.619873] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.619966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.620070] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.620161] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.620309] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.620401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.620487] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.620939] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.621042] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.621143] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.621202] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.621341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.621620] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.621749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.621866] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.025072] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cb96f49-e1ce-4f04-bd15-5f3cbd823cb0 [ 958.025350] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.025590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.025590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.025848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.025952] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.027046] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cb96f49-e1ce-4f04-bd15-5f3cbd823cb0 already deleted. [ 958.027046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cb96f49-e1ce-4f04-bd15-5f3cbd823cb0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.124902] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c93d149b-db2a-420d-81f5-177c6bdd9505: rpc.has_security_group_logging(os_id): False [ 958.150035] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.150035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.150035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.150035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.150035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.150035] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.150035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.150035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.150035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.150035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.150035] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.150035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.150035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.150035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.150035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.150814] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.150814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.150814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.150814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.150814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.154792] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be updated. [ 958.200907] env[66519]: INFO networking_nsxv3.common.synchronization [req-f0012c0e-172f-4602-a5c0-e99144afd698 req-af49b6a8-b165-484a-8cba-72bd2803d878 tempest-ServersTestJSON-971253557 tempest-ServersTestJSON-971253557-project-member] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 958.201470] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 958.201776] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.201895] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.201963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.202172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.202611] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.202611] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.202611] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.202785] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.202840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.202920] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.232144] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.232337] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.232413] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.232747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.232980] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.258907] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: IN_PROGRESS for 2s [ 958.705248] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.208904] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.436051] env[66519]: INFO networking_nsxv3.common.synchronization [req-2dd3ace2-cda0-4542-a8ac-ad14fa8fd700 req-ce0c1756-8ed6-4a1d-9713-ab0896228ff4 tempest-ServerRescueTestJSON-1068866122 tempest-ServerRescueTestJSON-1068866122-project-member] Enqueued Resource ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 with Priority: HIGHEST for action security_group_members [ 959.437065] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 with Priority: HIGHEST for action security_group_members [ 959.437664] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.438522] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.438522] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.438522] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.438754] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.438836] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.439126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.439662] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.439662] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.439662] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.713620] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.714180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.714180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.714492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.714632] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.714784] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 959.762874] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.762874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.763061] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.763416] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.763659] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.786221] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 959.946543] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.946737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.946797] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.946972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.947122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.947341] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.947453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.947512] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.947701] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.947777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.947875] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 is going to be updated. [ 959.983828] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.984039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.984088] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.984389] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.984490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.998172] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 in Status: IN_PROGRESS for 2s [ 960.306264] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: SUCCESS [ 960.306748] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.496466] env[66519]: INFO networking_nsxv3.common.synchronization [None req-2f8a04a6-8119-4755-ad83-9bd31582b3b9 None None] Enqueued Resource ID: 90f743c3-7ff6-4fcb-989d-e5ef0d664ce1 with Priority: HIGHEST for action port [ 960.496466] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90f743c3-7ff6-4fcb-989d-e5ef0d664ce1 with Priority: HIGHEST for action port [ 960.496466] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-90f743c3-7ff6-4fcb-989d-e5ef0d664ce1 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.496466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90f743c3-7ff6-4fcb-989d-e5ef0d664ce1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.496466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90f743c3-7ff6-4fcb-989d-e5ef0d664ce1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.496466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90f743c3-7ff6-4fcb-989d-e5ef0d664ce1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.496466] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90f743c3-7ff6-4fcb-989d-e5ef0d664ce1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.001641] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90f743c3-7ff6-4fcb-989d-e5ef0d664ce1 [ 961.001875] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.002057] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.002154] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.002396] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.002489] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.002588] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90f743c3-7ff6-4fcb-989d-e5ef0d664ce1 already deleted. [ 961.002671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90f743c3-7ff6-4fcb-989d-e5ef0d664ce1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.803920] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 961.804431] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.019576] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 in Status: SUCCESS [ 962.019576] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9 deletion is rescheduled due to dependency. [ 962.019576] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.916889] env[66519]: INFO networking_nsxv3.common.synchronization [req-54c62417-5675-4b2f-be9d-79a63806e41e req-6cd8b38c-32ae-40b5-a2eb-eff349167af6 tempest-ServersTestFqdnHostnames-927688424 tempest-ServersTestFqdnHostnames-927688424-project-member] Enqueued Resource ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 with Priority: HIGHEST for action security_group_members [ 962.917784] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 with Priority: HIGHEST for action security_group_members [ 962.918331] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c13785-2872-4af9-91d3-148ba8f8cc39 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.918630] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.918630] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.919802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.919802] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.919802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.919802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.919802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.920111] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.920111] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60c13785-2872-4af9-91d3-148ba8f8cc39',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.356502] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-267 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.356697] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-267" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.356824] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-267" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.357395] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-267" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.357680] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.357869] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.357989] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.358315] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.358468] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.358740] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 963.358870] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 963.358982] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 963.359104] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 963.359216] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 963.359319] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 963.359453] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 963.382015] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 963.382326] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 963.382326] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 963.382440] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-267" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.382843] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-89788ce2-29a9-4f7a-9d7b-7f71d74e6c51 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.383012] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-89788ce2-29a9-4f7a-9d7b-7f71d74e6c51" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.383136] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-89788ce2-29a9-4f7a-9d7b-7f71d74e6c51" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.383520] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-89788ce2-29a9-4f7a-9d7b-7f71d74e6c51" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.383667] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89788ce2-29a9-4f7a-9d7b-7f71d74e6c51',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.422255] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.422525] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.422807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.422947] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.423123] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.423413] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.423554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.423670] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.423886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.424017] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.424162] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 already deleted. [ 963.424312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.887641] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.887879] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.888011] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.888329] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.888477] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.888645] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 89788ce2-29a9-4f7a-9d7b-7f71d74e6c51 not found, creating... [ 963.889037] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.889215] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.889352] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.889649] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.890073] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.890167] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.890348] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.890507] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.890735] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.891029] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.891145] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 89788ce2-29a9-4f7a-9d7b-7f71d74e6c51 is going to be created. [ 963.918096] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.918437] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.918437] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.918831] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.919104] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.919318] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-89788ce2-29a9-4f7a-9d7b-7f71d74e6c51" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.653069] env[66519]: INFO networking_nsxv3.common.synchronization [req-54c62417-5675-4b2f-be9d-79a63806e41e req-ec795d02-eb2e-4224-a791-5037a3f571f5 service nova] Enqueued Resource ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 with Priority: HIGHEST for action security_group_rules [ 964.653374] env[66519]: INFO networking_nsxv3.common.synchronization [req-54c62417-5675-4b2f-be9d-79a63806e41e req-ec795d02-eb2e-4224-a791-5037a3f571f5 service nova] Enqueued Resource ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 with Priority: HIGHEST for action security_group_members [ 964.658754] env[66519]: INFO networking_nsxv3.common.synchronization [req-54c62417-5675-4b2f-be9d-79a63806e41e req-ec795d02-eb2e-4224-a791-5037a3f571f5 service nova] Enqueued Resource ID: 89788ce2-29a9-4f7a-9d7b-7f71d74e6c51 with Priority: HIGHEST for action port [ 964.659678] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 with Priority: HIGHEST for action security_group_rules [ 964.660153] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 with Priority: HIGHEST for action security_group_members [ 964.662037] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89788ce2-29a9-4f7a-9d7b-7f71d74e6c51 with Priority: HIGHEST for action port [ 964.662037] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60c13785-2872-4af9-91d3-148ba8f8cc39 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.662037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.662037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.662037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.662037] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60c13785-2872-4af9-91d3-148ba8f8cc39',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.668290] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c13785-2872-4af9-91d3-148ba8f8cc39 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.668290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.668290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.668290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.668290] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.668290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.668290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.668290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.668290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.668290] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60c13785-2872-4af9-91d3-148ba8f8cc39',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.669633] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-89788ce2-29a9-4f7a-9d7b-7f71d74e6c51 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.669633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89788ce2-29a9-4f7a-9d7b-7f71d74e6c51" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.669633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89788ce2-29a9-4f7a-9d7b-7f71d74e6c51" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.669850] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89788ce2-29a9-4f7a-9d7b-7f71d74e6c51" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.669850] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89788ce2-29a9-4f7a-9d7b-7f71d74e6c51',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.854084] env[66519]: INFO networking_nsxv3.common.synchronization [None req-bee7a263-7403-48af-8a9f-d74d051b27ce None None] Enqueued Resource ID: cae15039-8f99-4e10-8323-d00d976b009c with Priority: HIGHEST for action port [ 964.857312] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cae15039-8f99-4e10-8323-d00d976b009c with Priority: HIGHEST for action port [ 964.857312] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-cae15039-8f99-4e10-8323-d00d976b009c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.857312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cae15039-8f99-4e10-8323-d00d976b009c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.857312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cae15039-8f99-4e10-8323-d00d976b009c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.857312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cae15039-8f99-4e10-8323-d00d976b009c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.857312] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cae15039-8f99-4e10-8323-d00d976b009c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.174606] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60c13785-2872-4af9-91d3-148ba8f8cc39',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.179497] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c13785-2872-4af9-91d3-148ba8f8cc39 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.179497] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.179497] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89788ce2-29a9-4f7a-9d7b-7f71d74e6c51 with status ACTIVE [ 965.179497] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.179497] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.179497] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.179497] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.179497] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.179497] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.179497] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.180285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.180285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.180285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.180285] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.180525] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.180630] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.181078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.181078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.181177] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89788ce2-29a9-4f7a-9d7b-7f71d74e6c51 is going to be updated. [ 965.209178] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.209388] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.209448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.209665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.209816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.209994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89788ce2-29a9-4f7a-9d7b-7f71d74e6c51" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.362090] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cae15039-8f99-4e10-8323-d00d976b009c [ 965.362834] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.362834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.362834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.362834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.362834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.363114] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cae15039-8f99-4e10-8323-d00d976b009c already deleted. [ 965.363114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cae15039-8f99-4e10-8323-d00d976b009c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.678287] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60c13785-2872-4af9-91d3-148ba8f8cc39',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.792323] env[66519]: INFO networking_nsxv3.common.synchronization [req-4a07ad4b-b7fd-46d4-9537-78e2b6268a28 req-94d8bfa4-8889-46ff-8167-f4ccb2c36451 tempest-ServerRescueTestJSONUnderV235-343565798 tempest-ServerRescueTestJSONUnderV235-343565798-project-member] Enqueued Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_members [ 965.792573] env[66519]: INFO networking_nsxv3.common.synchronization [req-4a07ad4b-b7fd-46d4-9537-78e2b6268a28 req-94d8bfa4-8889-46ff-8167-f4ccb2c36451 tempest-ServerRescueTestJSONUnderV235-343565798 tempest-ServerRescueTestJSONUnderV235-343565798-project-member] Enqueued Resource ID: 66701b8a-83df-4c9d-99d8-f4017d453f8f with Priority: HIGHEST for action security_group_members [ 965.793279] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_members [ 965.793471] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66701b8a-83df-4c9d-99d8-f4017d453f8f with Priority: HIGHEST for action security_group_members [ 965.793784] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d11ddda-ea1f-4e83-8a8e-a42a470af616 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.793930] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.794293] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.794638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.794875] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.795097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.796195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.796195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.796195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.796195] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.797266] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-66701b8a-83df-4c9d-99d8-f4017d453f8f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.798951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.799064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.799349] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.799470] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.799670] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.799670] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.799801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.799883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.799985] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66701b8a-83df-4c9d-99d8-f4017d453f8f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.857459] env[66519]: INFO networking_nsxv3.common.synchronization [req-4a07ad4b-b7fd-46d4-9537-78e2b6268a28 req-94d8bfa4-8889-46ff-8167-f4ccb2c36451 tempest-ServerRescueTestJSONUnderV235-343565798 tempest-ServerRescueTestJSONUnderV235-343565798-project-member] Enqueued Resource ID: 66701b8a-83df-4c9d-99d8-f4017d453f8f with Priority: HIGHEST for action security_group_rules [ 965.857725] env[66519]: INFO networking_nsxv3.common.synchronization [req-4a07ad4b-b7fd-46d4-9537-78e2b6268a28 req-94d8bfa4-8889-46ff-8167-f4ccb2c36451 tempest-ServerRescueTestJSONUnderV235-343565798 tempest-ServerRescueTestJSONUnderV235-343565798-project-member] Enqueued Resource ID: 66701b8a-83df-4c9d-99d8-f4017d453f8f with Priority: HIGHEST for action security_group_members [ 965.857870] env[66519]: INFO networking_nsxv3.common.synchronization [req-4a07ad4b-b7fd-46d4-9537-78e2b6268a28 req-94d8bfa4-8889-46ff-8167-f4ccb2c36451 tempest-ServerRescueTestJSONUnderV235-343565798 tempest-ServerRescueTestJSONUnderV235-343565798-project-member] Enqueued Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_rules [ 965.858011] env[66519]: INFO networking_nsxv3.common.synchronization [req-4a07ad4b-b7fd-46d4-9537-78e2b6268a28 req-94d8bfa4-8889-46ff-8167-f4ccb2c36451 tempest-ServerRescueTestJSONUnderV235-343565798 tempest-ServerRescueTestJSONUnderV235-343565798-project-member] Enqueued Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_members [ 965.858298] env[66519]: INFO networking_nsxv3.common.synchronization [req-4a07ad4b-b7fd-46d4-9537-78e2b6268a28 req-94d8bfa4-8889-46ff-8167-f4ccb2c36451 tempest-ServerRescueTestJSONUnderV235-343565798 tempest-ServerRescueTestJSONUnderV235-343565798-project-member] Enqueued Resource ID: 74818530-aa74-4d97-be24-73ccada63434 with Priority: HIGHEST for action port [ 965.858895] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66701b8a-83df-4c9d-99d8-f4017d453f8f with Priority: HIGHEST for action security_group_rules [ 965.859042] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_rules [ 965.859259] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74818530-aa74-4d97-be24-73ccada63434 with Priority: HIGHEST for action port [ 965.859259] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66701b8a-83df-4c9d-99d8-f4017d453f8f with Priority: HIGHEST for action security_group_members [ 965.859378] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_members [ 965.859687] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66701b8a-83df-4c9d-99d8-f4017d453f8f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.859821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.859888] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.860182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.860853] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66701b8a-83df-4c9d-99d8-f4017d453f8f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.862344] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d11ddda-ea1f-4e83-8a8e-a42a470af616 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.862344] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.862344] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.862344] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.862344] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.862767] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-74818530-aa74-4d97-be24-73ccada63434 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.863706] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74818530-aa74-4d97-be24-73ccada63434" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.863706] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74818530-aa74-4d97-be24-73ccada63434" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.863962] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74818530-aa74-4d97-be24-73ccada63434" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.864412] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74818530-aa74-4d97-be24-73ccada63434',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.864911] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-66701b8a-83df-4c9d-99d8-f4017d453f8f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.865106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.866882] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d11ddda-ea1f-4e83-8a8e-a42a470af616 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.866882] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.183916] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.183916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.183916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.183916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.183916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.184506] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 is going to be created. [ 966.216129] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.216350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.216406] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.216643] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.216848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.230448] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 in Status: UNINITIALIZED for 2s [ 966.302235] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.305436] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66701b8a-83df-4c9d-99d8-f4017d453f8f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.367699] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d11ddda-ea1f-4e83-8a8e-a42a470af616 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.368795] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.369140] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-66701b8a-83df-4c9d-99d8-f4017d453f8f taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.369241] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.369425] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74818530-aa74-4d97-be24-73ccada63434 with status ACTIVE [ 966.369582] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.369687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.369745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.369961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.370061] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.370240] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.370341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.370401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.370557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.370631] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.370985] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.370985] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.370985] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.371163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.371163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.371256] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74818530-aa74-4d97-be24-73ccada63434 is going to be updated. [ 966.407795] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.408616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.408616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.409427] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.409427] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.409427] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74818530-aa74-4d97-be24-73ccada63434" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.662690] env[66519]: INFO networking_nsxv3.common.synchronization [req-b444cb69-9d64-4c36-a0f5-bce795c2aa57 req-90999a48-cda7-400f-b0bd-755f63655505 tempest-ServerRescueTestJSONUnderV235-343565798 tempest-ServerRescueTestJSONUnderV235-343565798-project-member] Enqueued Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_members [ 966.662690] env[66519]: INFO networking_nsxv3.common.synchronization [req-b444cb69-9d64-4c36-a0f5-bce795c2aa57 req-90999a48-cda7-400f-b0bd-755f63655505 tempest-ServerRescueTestJSONUnderV235-343565798 tempest-ServerRescueTestJSONUnderV235-343565798-project-member] Enqueued Resource ID: 66701b8a-83df-4c9d-99d8-f4017d453f8f with Priority: HIGHEST for action security_group_members [ 966.662690] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_members [ 966.662690] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66701b8a-83df-4c9d-99d8-f4017d453f8f with Priority: HIGHEST for action security_group_members [ 966.662690] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d11ddda-ea1f-4e83-8a8e-a42a470af616 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.662690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.662690] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-66701b8a-83df-4c9d-99d8-f4017d453f8f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.662690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.748134] env[66519]: INFO networking_nsxv3.common.synchronization [req-b444cb69-9d64-4c36-a0f5-bce795c2aa57 req-90999a48-cda7-400f-b0bd-755f63655505 tempest-ServerRescueTestJSONUnderV235-343565798 tempest-ServerRescueTestJSONUnderV235-343565798-project-member] Enqueued Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_rules [ 966.748348] env[66519]: INFO networking_nsxv3.common.synchronization [req-b444cb69-9d64-4c36-a0f5-bce795c2aa57 req-90999a48-cda7-400f-b0bd-755f63655505 tempest-ServerRescueTestJSONUnderV235-343565798 tempest-ServerRescueTestJSONUnderV235-343565798-project-member] Enqueued Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_members [ 966.748452] env[66519]: INFO networking_nsxv3.common.synchronization [req-b444cb69-9d64-4c36-a0f5-bce795c2aa57 req-90999a48-cda7-400f-b0bd-755f63655505 tempest-ServerRescueTestJSONUnderV235-343565798 tempest-ServerRescueTestJSONUnderV235-343565798-project-member] Enqueued Resource ID: 74818530-aa74-4d97-be24-73ccada63434 with Priority: HIGHEST for action port [ 966.749158] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_rules [ 966.749291] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_members [ 966.749398] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74818530-aa74-4d97-be24-73ccada63434 with Priority: HIGHEST for action port [ 966.749691] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d11ddda-ea1f-4e83-8a8e-a42a470af616 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.749803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.749978] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d11ddda-ea1f-4e83-8a8e-a42a470af616 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.750106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.751039] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-74818530-aa74-4d97-be24-73ccada63434 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.751039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74818530-aa74-4d97-be24-73ccada63434" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.751039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74818530-aa74-4d97-be24-73ccada63434" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.751039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74818530-aa74-4d97-be24-73ccada63434" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.751039] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74818530-aa74-4d97-be24-73ccada63434',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.807460] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.808744] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66701b8a-83df-4c9d-99d8-f4017d453f8f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.255297] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74818530-aa74-4d97-be24-73ccada63434 with status ACTIVE [ 967.255654] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.255823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.255907] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.256212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.256313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.256525] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.256631] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.256694] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.256857] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.256937] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.257254] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.257369] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.257423] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.257572] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.257647] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.257729] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74818530-aa74-4d97-be24-73ccada63434 is going to be updated. [ 967.304816] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.305056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.305056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.305366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.305574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.305684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74818530-aa74-4d97-be24-73ccada63434" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.311570] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.311740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.311810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.312038] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.312129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.312228] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 is going to be updated. [ 967.313653] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.313783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.313853] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.315057] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.315057] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.315057] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66701b8a-83df-4c9d-99d8-f4017d453f8f is going to be created. [ 967.324360] env[66519]: INFO networking_nsxv3.common.synchronization [None req-9cb21175-6732-4c5c-819f-38a1cdec36b0 tempest-ServerActionsTestOtherA-1261634680 tempest-ServerActionsTestOtherA-1261634680-project-member] Enqueued Resource ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 with Priority: HIGHEST for action security_group_rules [ 967.324360] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 with Priority: HIGHEST for action security_group_rules [ 967.324452] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9619a08c-5035-47ce-91cf-089cdb9ae303 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.325720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.325720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.325720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.325720] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9619a08c-5035-47ce-91cf-089cdb9ae303',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.329972] env[66519]: INFO networking_nsxv3.common.synchronization [None req-e9b95af9-d286-4b8a-a83f-dbe4ed6cce31 None None] Enqueued Resource ID: 208c03b0-e069-4bc0-98d6-037ecc6e0c68 with Priority: HIGHEST for action port [ 967.332659] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 208c03b0-e069-4bc0-98d6-037ecc6e0c68 with Priority: HIGHEST for action port [ 967.334321] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-208c03b0-e069-4bc0-98d6-037ecc6e0c68 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.336466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-208c03b0-e069-4bc0-98d6-037ecc6e0c68" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.336466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-208c03b0-e069-4bc0-98d6-037ecc6e0c68" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.336466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-208c03b0-e069-4bc0-98d6-037ecc6e0c68" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.336466] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('208c03b0-e069-4bc0-98d6-037ecc6e0c68',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.358680] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.359257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.359257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.359333] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.359598] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.380059] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66701b8a-83df-4c9d-99d8-f4017d453f8f in Status: UNINITIALIZED for 2s [ 967.382878] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.383317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.383317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.383317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.383486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.402848] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 in Status: IN_PROGRESS for 2s [ 967.477198] env[66519]: INFO networking_nsxv3.common.synchronization [None req-d22bdad5-7e24-4da3-b2d4-b00ad3686ec3 tempest-ServerActionsTestOtherA-1261634680 tempest-ServerActionsTestOtherA-1261634680-project-member] Enqueued Resource ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 with Priority: HIGHEST for action security_group_rules [ 967.477586] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 with Priority: HIGHEST for action security_group_rules [ 967.477892] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9619a08c-5035-47ce-91cf-089cdb9ae303 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.478102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.794778] env[66519]: INFO networking_nsxv3.common.synchronization [req-17eb22b7-d80e-4f9c-89da-00fcc091ab04 req-cd653503-f5c5-4af6-ace7-3b994dcc3887 tempest-AttachVolumeShelveTestJSON-264753527 tempest-AttachVolumeShelveTestJSON-264753527-project-member] Enqueued Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGHEST for action security_group_members [ 967.795274] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGHEST for action security_group_members [ 967.795575] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b4e85b6-ed99-4ac0-9639-f46dc275381b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.795684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.795759] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.796012] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.796852] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.796975] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.797064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.797353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.797472] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.797597] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.840684] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 208c03b0-e069-4bc0-98d6-037ecc6e0c68 [ 967.841120] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.841326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.841408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.841704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.841803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.841875] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:208c03b0-e069-4bc0-98d6-037ecc6e0c68 already deleted. [ 967.841951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-208c03b0-e069-4bc0-98d6-037ecc6e0c68" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.858466] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.858705] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.858790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.859203] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.859451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.859583] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 already deleted. [ 967.859729] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.860065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.860237] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.860375] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9619a08c-5035-47ce-91cf-089cdb9ae303',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.241728] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 in Status: SUCCESS [ 968.241904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.242039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.242340] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.242467] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.242604] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.242671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.242827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.242934] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.243018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.243088] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60c13785-2872-4af9-91d3-148ba8f8cc39',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.258543] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-947 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.260260] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-947" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.260260] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-947" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.260260] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-947" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.260260] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.260513] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.260670] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.260930] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.261081] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.261301] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.261404] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.261505] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.261608] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.261717] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.261819] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.262119] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.282649] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.282649] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 968.282866] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.283030] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-947" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.283520] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-bc01cd10-ec7a-441f-b1b6-d25323c0db02 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.283717] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-bc01cd10-ec7a-441f-b1b6-d25323c0db02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.284031] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-bc01cd10-ec7a-441f-b1b6-d25323c0db02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.284309] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-bc01cd10-ec7a-441f-b1b6-d25323c0db02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.284457] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc01cd10-ec7a-441f-b1b6-d25323c0db02',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.301109] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.301367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.301367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.301543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.301629] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.301830] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.301930] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.302054] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.302163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.302238] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.302322] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b already deleted. [ 968.302403] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.381525] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.381679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.381775] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.382011] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.382187] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.382293] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 already deleted. [ 968.382408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.745297] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60c13785-2872-4af9-91d3-148ba8f8cc39',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.790023] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.790023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.790023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.790023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.790023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.790023] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port bc01cd10-ec7a-441f-b1b6-d25323c0db02 not found, creating... [ 968.790023] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.790023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.790023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.790023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.790023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.798382] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.798849] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.799196] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.799616] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.800222] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.800796] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: bc01cd10-ec7a-441f-b1b6-d25323c0db02 is going to be created. [ 968.826181] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.826380] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.826502] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.826780] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.827020] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.827485] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-bc01cd10-ec7a-441f-b1b6-d25323c0db02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.248140] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60c13785-2872-4af9-91d3-148ba8f8cc39: rpc.has_security_group_logging(os_id): False [ 969.269641] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.270072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.270072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.270215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.270693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.270693] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.270987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.270987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.271311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.271311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.271408] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 is going to be created. [ 969.369370] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.369610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.369730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.370107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.370745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.397385] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66701b8a-83df-4c9d-99d8-f4017d453f8f in Status: SUCCESS [ 969.397720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.397949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.399684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.399941] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.400116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.400223] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.400566] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.400709] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.400792] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66701b8a-83df-4c9d-99d8-f4017d453f8f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.402525] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 in Status: IN_PROGRESS for 2s [ 969.416997] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 in Status: SUCCESS [ 969.417617] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.418408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.418670] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.418884] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.419014] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.419093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.419259] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.419346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.419446] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.581532] env[66519]: INFO networking_nsxv3.common.synchronization [req-17eb22b7-d80e-4f9c-89da-00fcc091ab04 req-4cdd8aff-6704-43b5-8946-e3ef20bee921 service nova] Enqueued Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGHEST for action security_group_rules [ 969.581755] env[66519]: INFO networking_nsxv3.common.synchronization [req-17eb22b7-d80e-4f9c-89da-00fcc091ab04 req-4cdd8aff-6704-43b5-8946-e3ef20bee921 service nova] Enqueued Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGHEST for action security_group_members [ 969.581890] env[66519]: INFO networking_nsxv3.common.synchronization [req-17eb22b7-d80e-4f9c-89da-00fcc091ab04 req-4cdd8aff-6704-43b5-8946-e3ef20bee921 service nova] Enqueued Resource ID: bc01cd10-ec7a-441f-b1b6-d25323c0db02 with Priority: HIGHEST for action port [ 969.582614] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGHEST for action security_group_rules [ 969.582758] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGHEST for action security_group_members [ 969.582907] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc01cd10-ec7a-441f-b1b6-d25323c0db02 with Priority: HIGHEST for action port [ 969.583282] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.583374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.583442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.583675] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.583784] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.585358] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b4e85b6-ed99-4ac0-9639-f46dc275381b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.585638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.585737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.585985] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.586256] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.586326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.586392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.586595] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.586683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.586778] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.587803] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc01cd10-ec7a-441f-b1b6-d25323c0db02 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.587905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc01cd10-ec7a-441f-b1b6-d25323c0db02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.587982] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc01cd10-ec7a-441f-b1b6-d25323c0db02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.588195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc01cd10-ec7a-441f-b1b6-d25323c0db02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.588290] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc01cd10-ec7a-441f-b1b6-d25323c0db02',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.906017] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.906225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.906333] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.906711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.906867] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.907221] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.907387] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.907485] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.907715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.907860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.907902] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66701b8a-83df-4c9d-99d8-f4017d453f8f is going to be deleted. [ 969.922324] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.948981] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.948981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.948981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.948981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.948981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.948981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.949230] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.949230] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.949352] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.949459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.949521] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.949663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.949740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.949837] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66701b8a-83df-4c9d-99d8-f4017d453f8f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.092748] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b4e85b6-ed99-4ac0-9639-f46dc275381b taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.092748] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.093036] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.094147] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc01cd10-ec7a-441f-b1b6-d25323c0db02 with status ACTIVE [ 970.094147] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.094147] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.094641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.094641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.094641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.096436] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.096436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.096436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.096436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.096436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.096436] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.096436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.096436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.096436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.096436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.096436] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc01cd10-ec7a-441f-b1b6-d25323c0db02 is going to be updated. [ 970.124502] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.124633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.124719] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.124928] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.125168] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.125282] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc01cd10-ec7a-441f-b1b6-d25323c0db02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.427018] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.455363] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.455602] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.455602] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.455825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.455919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.456192] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.456333] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.456394] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.456593] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.456656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.456733] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66701b8a-83df-4c9d-99d8-f4017d453f8f already deleted. [ 970.456811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.456912] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66701b8a-83df-4c9d-99d8-f4017d453f8f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.458040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.458237] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.458308] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.458433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.458509] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.458687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.458777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.458899] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66701b8a-83df-4c9d-99d8-f4017d453f8f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.597596] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.933571] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.933716] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.933785] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.934016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.934099] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.934195] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 is going to be updated. [ 970.962048] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.962048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.962048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.962048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.962048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.962419] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.962496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.962614] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.962765] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.962858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.962944] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66701b8a-83df-4c9d-99d8-f4017d453f8f already deleted. [ 970.963063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.963414] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66701b8a-83df-4c9d-99d8-f4017d453f8f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.969827] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.969987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.970145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.970268] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.970442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.983212] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 in Status: IN_PROGRESS for 2s [ 971.105919] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.105919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.105919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.105919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.105919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.105919] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b is going to be created. [ 971.160378] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.160586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.160678] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.160884] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.161219] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.177225] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b in Status: UNINITIALIZED for 2s [ 971.416141] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 in Status: SUCCESS [ 971.416286] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.470183] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66701b8a-83df-4c9d-99d8-f4017d453f8f: rpc.has_security_group_logging(os_id): False [ 971.510470] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.510650] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.510693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.510907] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.510998] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.511265] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.511335] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.511700] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.511700] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.511700] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.511700] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66701b8a-83df-4c9d-99d8-f4017d453f8f is going to be created. [ 971.535332] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/66701b8a-83df-4c9d-99d8-f4017d453f8f], does not exist path=[/infra/domains/default/groups/66701b8a-83df-4c9d-99d8-f4017d453f8f]."\n}' [ 971.535469] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66701b8a-83df-4c9d-99d8-f4017d453f8f failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/66701b8a-83df-4c9d-99d8-f4017d453f8f [ 971.535469] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 971.578060] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.578227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.578331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.578543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.580149] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.580574] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.580698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.580805] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.580986] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.581212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.581449] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.581567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.581646] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.581834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.581913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.582038] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66701b8a-83df-4c9d-99d8-f4017d453f8f is going to be created. [ 971.606086] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/66701b8a-83df-4c9d-99d8-f4017d453f8f], does not exist path=[/infra/domains/default/groups/66701b8a-83df-4c9d-99d8-f4017d453f8f]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/66701b8a-83df-4c9d-99d8-f4017d453f8f [ 971.606286] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66701b8a-83df-4c9d-99d8-f4017d453f8f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.606821] env[66519]: Traceback (most recent call last): [ 971.606915] env[66519]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 971.606915] env[66519]: return func(*args, **kwargs) [ 971.606915] env[66519]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 971.606915] env[66519]: res.raise_for_status() [ 971.606915] env[66519]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 971.606915] env[66519]: raise HTTPError(http_error_msg, response=self) [ 971.606915] env[66519]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/66701b8a-83df-4c9d-99d8-f4017d453f8f [ 971.606915] env[66519]: During handling of the above exception, another exception occurred: [ 971.606915] env[66519]: Traceback (most recent call last): [ 971.606915] env[66519]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 971.606915] env[66519]: listener.cb(fileno) [ 971.606915] env[66519]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 971.606915] env[66519]: result = function(*args, **kwargs) [ 971.606915] env[66519]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 971.606915] env[66519]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 971.606915] env[66519]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 971.606915] env[66519]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 971.606915] env[66519]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 971.606915] env[66519]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 971.606915] env[66519]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 971.606915] env[66519]: res.raise_for_status() [ 971.606915] env[66519]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 971.606915] env[66519]: raise HTTPError(http_error_msg, response=self) [ 971.606915] env[66519]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/66701b8a-83df-4c9d-99d8-f4017d453f8f [ 971.606915] env[66519]: Removing descriptor: 62 [ 972.998284] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 in Status: SUCCESS [ 972.998284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.998284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.998284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.998284] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.998284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.998284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.998284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.998284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.998284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.998284] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.998923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.998923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.000103] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.000103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.000103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.000103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.000103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.000420] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.188968] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b in Status: SUCCESS [ 973.189217] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.190568] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.190814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.191040] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.191168] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.191232] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.191407] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.191490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.191600] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.191742] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.210780] env[66519]: INFO networking_nsxv3.common.synchronization [req-9d46ce1f-deb1-4037-bd40-9301dd13bcb4 req-c60073c3-f2dd-4459-9db6-bdecf276e843 tempest-ServersAdminTestJSON-863383517 tempest-ServersAdminTestJSON-863383517-project-member] Enqueued Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 973.210780] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 973.210926] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.210996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.211080] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.211553] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.211553] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.211719] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.211719] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.211823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.211877] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.212018] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.424354] env[66519]: INFO networking_nsxv3.common.synchronization [req-d501d77f-84fa-4160-b85e-3f8e59cd2d6f req-e5f774a5-a476-44e6-8d17-a534b94690a7 tempest-ImagesTestJSON-1420515381 tempest-ImagesTestJSON-1420515381-project-member] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 973.424917] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 973.425250] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.425852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.425852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.425852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.425852] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.426068] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.426068] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.427777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.427777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.430022] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.501994] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d11ddda-ea1f-4e83-8a8e-a42a470af616 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.502140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.502328] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.554419] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-314 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.554419] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.554842] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.554842] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.556063] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.556063] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.556063] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.556063] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.556349] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.557100] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 973.557100] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 973.557100] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 973.557100] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 973.557290] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 973.557290] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 973.557412] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 973.579652] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 973.579920] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 973.580169] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 973.580421] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.581595] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-d291cecc-d761-4088-ab0a-81e641f3f91e taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.581595] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-d291cecc-d761-4088-ab0a-81e641f3f91e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.581595] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-d291cecc-d761-4088-ab0a-81e641f3f91e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.581595] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-d291cecc-d761-4088-ab0a-81e641f3f91e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.581595] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d291cecc-d761-4088-ab0a-81e641f3f91e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.697301] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.714568] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.714857] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.715069] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.715507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.715750] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.716150] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.716308] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.716378] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.716579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.716664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.716755] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 already deleted. [ 973.716836] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.930020] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.006210] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.086821] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.086821] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.086821] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.086821] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.086821] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.086821] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port d291cecc-d761-4088-ab0a-81e641f3f91e not found, creating... [ 974.086821] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.087606] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.087606] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.087606] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.087606] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.088426] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.088426] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.088426] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.088426] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.088829] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.088829] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: d291cecc-d761-4088-ab0a-81e641f3f91e is going to be created. [ 974.119173] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.119409] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.119713] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.120115] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.120404] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.120727] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-d291cecc-d761-4088-ab0a-81e641f3f91e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.200054] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b4e85b6-ed99-4ac0-9639-f46dc275381b: rpc.has_security_group_logging(os_id): False [ 974.223826] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.223826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.223826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.223826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.223826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.224189] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.224189] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.224189] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.224359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.224456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.224571] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b is going to be created. [ 974.313939] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.314125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.314197] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.314423] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.314672] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.329516] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b in Status: IN_PROGRESS for 2s [ 974.433507] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.509467] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.509692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.509692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.510046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.510166] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.510273] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 is going to be updated. [ 974.545914] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.546160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.546232] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.546749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.546749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.558341] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 in Status: IN_PROGRESS for 2s [ 974.897945] env[66519]: INFO networking_nsxv3.common.synchronization [req-9d46ce1f-deb1-4037-bd40-9301dd13bcb4 req-215ec246-42f7-45b0-ac7f-4bad2c553454 service nova] Enqueued Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_rules [ 974.897945] env[66519]: INFO networking_nsxv3.common.synchronization [req-9d46ce1f-deb1-4037-bd40-9301dd13bcb4 req-215ec246-42f7-45b0-ac7f-4bad2c553454 service nova] Enqueued Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 974.897945] env[66519]: INFO networking_nsxv3.common.synchronization [req-9d46ce1f-deb1-4037-bd40-9301dd13bcb4 req-215ec246-42f7-45b0-ac7f-4bad2c553454 service nova] Enqueued Resource ID: d291cecc-d761-4088-ab0a-81e641f3f91e with Priority: HIGHEST for action port [ 974.898827] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_rules [ 974.898827] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 974.898827] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d291cecc-d761-4088-ab0a-81e641f3f91e with Priority: HIGHEST for action port [ 974.898969] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.899284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.899397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.899770] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.899886] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.902194] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.902194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.902194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.902194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.902194] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.902194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.903295] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.903295] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.903295] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.903295] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.906285] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-d291cecc-d761-4088-ab0a-81e641f3f91e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.906285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d291cecc-d761-4088-ab0a-81e641f3f91e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.906285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d291cecc-d761-4088-ab0a-81e641f3f91e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.906285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d291cecc-d761-4088-ab0a-81e641f3f91e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.906285] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d291cecc-d761-4088-ab0a-81e641f3f91e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.936732] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.936900] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.936942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.937195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.937289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.937390] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be updated. [ 975.063885] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.064286] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.064286] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.064663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.064663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.081287] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: IN_PROGRESS for 2s [ 975.364483] env[66519]: INFO networking_nsxv3.common.synchronization [req-f597adc3-aec2-4b54-8959-f95058bbcb1a req-ddc11a73-0e87-4698-9fcf-5d2517f8f7fd tempest-ServerRescueTestJSONUnderV235-343565798 tempest-ServerRescueTestJSONUnderV235-343565798-project-member] Enqueued Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_members [ 975.366664] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 with Priority: HIGHEST for action security_group_members [ 975.367059] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d11ddda-ea1f-4e83-8a8e-a42a470af616 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.367307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.407906] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.408135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.408436] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.410077] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d291cecc-d761-4088-ab0a-81e641f3f91e with status ACTIVE [ 975.410274] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.410421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.410530] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.410785] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.412451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.412650] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.412790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.412855] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.414551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.414551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.414551] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.414551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.414551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.414551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.414551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.414551] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d291cecc-d761-4088-ab0a-81e641f3f91e is going to be updated. [ 975.441694] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.442008] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.442202] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.442475] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.442665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.443798] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d291cecc-d761-4088-ab0a-81e641f3f91e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.634332] env[66519]: INFO networking_nsxv3.common.synchronization [req-a59c1d13-6518-4e32-b455-5470b09b1969 req-5800084c-1ff2-4493-8f35-0d4377008ed2 tempest-ServersWithSpecificFlavorTestJSON-1863263519 tempest-ServersWithSpecificFlavorTestJSON-1863263519-project-member] Enqueued Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_members [ 975.638031] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393aa0d3-c462-4737-b799-041054ed8323 with Priority: HIGHEST for action security_group_members [ 975.638433] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-393aa0d3-c462-4737-b799-041054ed8323 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.638969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.639090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.642295] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.642483] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.642593] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.642661] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.643058] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.643058] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.643058] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('393aa0d3-c462-4737-b799-041054ed8323',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.911072] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.145985] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.146274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.146274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.147088] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.172390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.172390] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.172390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.172390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.172390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.172390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.172390] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393aa0d3-c462-4737-b799-041054ed8323 is going to be updated. [ 976.200697] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.200697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.200697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.201015] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.201015] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.210870] env[66519]: INFO networking_nsxv3.common.synchronization [req-66316afc-cff3-4745-8717-b81b36043db5 req-1c376557-d95d-4d0b-96a1-c450ef249631 tempest-ServersAdminTestJSON-863383517 tempest-ServersAdminTestJSON-863383517-project-member] Enqueued Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 976.212055] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 976.214509] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393aa0d3-c462-4737-b799-041054ed8323 in Status: IN_PROGRESS for 2s [ 976.214509] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.214509] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.344136] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b in Status: SUCCESS [ 976.344708] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.413439] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.413718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.414123] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.414198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.414341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.414499] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 is going to be created. [ 976.453202] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.453422] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.453638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.453909] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.454171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.476420] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: UNINITIALIZED for 2s [ 976.569894] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 in Status: SUCCESS [ 976.570814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.571103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.571605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.571870] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.572078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.572280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.572559] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.572697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.572852] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.594553] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-314 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.594788] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.594916] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.595321] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.595492] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.595648] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.596091] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.596396] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.596602] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.596873] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.597047] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.597294] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.597445] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.597655] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.597857] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.598085] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.621702] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.621913] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 976.622124] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.622353] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.622909] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-92eecac3-3ae8-4ca1-b66e-41a8e0d35650 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.623148] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-92eecac3-3ae8-4ca1-b66e-41a8e0d35650" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.623301] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-92eecac3-3ae8-4ca1-b66e-41a8e0d35650" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.623683] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-92eecac3-3ae8-4ca1-b66e-41a8e0d35650" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.623847] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92eecac3-3ae8-4ca1-b66e-41a8e0d35650',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.075191] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.075449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.075449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.075571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.090526] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: SUCCESS [ 977.090607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.096282] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.096569] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.096712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.096783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.096978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.097072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.097266] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 is going to be updated. [ 977.126971] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.127307] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.127466] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.127785] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.127960] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.128191] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 92eecac3-3ae8-4ca1-b66e-41a8e0d35650 not found, creating... [ 977.128527] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.128721] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.128841] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.129122] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.129267] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.129912] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.129912] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.130046] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.130199] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.130350] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.130520] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 92eecac3-3ae8-4ca1-b66e-41a8e0d35650 is going to be created. [ 977.133586] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.133694] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.133763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.133958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.134913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.146407] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 in Status: IN_PROGRESS for 2s [ 977.158746] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.158978] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.159118] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.159555] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.159949] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.160350] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-92eecac3-3ae8-4ca1-b66e-41a8e0d35650" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.899521] env[66519]: INFO networking_nsxv3.common.synchronization [req-66316afc-cff3-4745-8717-b81b36043db5 req-20dc00f8-5b63-4634-9470-d987ce8f18a1 service nova] Enqueued Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_rules [ 977.899709] env[66519]: INFO networking_nsxv3.common.synchronization [req-66316afc-cff3-4745-8717-b81b36043db5 req-20dc00f8-5b63-4634-9470-d987ce8f18a1 service nova] Enqueued Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 977.900424] env[66519]: INFO networking_nsxv3.common.synchronization [req-66316afc-cff3-4745-8717-b81b36043db5 req-20dc00f8-5b63-4634-9470-d987ce8f18a1 service nova] Enqueued Resource ID: 92eecac3-3ae8-4ca1-b66e-41a8e0d35650 with Priority: HIGHEST for action port [ 977.900424] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_rules [ 977.900608] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 977.900608] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92eecac3-3ae8-4ca1-b66e-41a8e0d35650 with Priority: HIGHEST for action port [ 977.900873] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.900993] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.902600] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.904298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.904609] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-92eecac3-3ae8-4ca1-b66e-41a8e0d35650 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.904736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92eecac3-3ae8-4ca1-b66e-41a8e0d35650" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.904803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92eecac3-3ae8-4ca1-b66e-41a8e0d35650" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.905189] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92eecac3-3ae8-4ca1-b66e-41a8e0d35650" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.905277] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92eecac3-3ae8-4ca1-b66e-41a8e0d35650',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.224644] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393aa0d3-c462-4737-b799-041054ed8323 in Status: IN_PROGRESS for 4s [ 978.398160] env[66519]: INFO networking_nsxv3.common.synchronization [req-8e7451b3-7a55-47e4-a052-bc1924e6ace0 req-a1658ac0-90b2-4d09-9b19-86da83928d66 tempest-ServersTestManualDisk-1887932989 tempest-ServersTestManualDisk-1887932989-project-member] Enqueued Resource ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 with Priority: HIGHEST for action security_group_members [ 978.398770] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 with Priority: HIGHEST for action security_group_members [ 978.399230] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.399329] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.399435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.399690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.399871] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.399976] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.400073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.400328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.400424] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.400519] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb0f115b-2ae8-4ea8-bf0a-99edddaaee58',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.409601] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92eecac3-3ae8-4ca1-b66e-41a8e0d35650 with status ACTIVE [ 978.409834] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.410326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.410859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.410859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.410859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.411016] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.411100] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.411162] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.411319] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.411398] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.411585] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.411666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.411995] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.411995] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.411995] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.412191] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92eecac3-3ae8-4ca1-b66e-41a8e0d35650 is going to be updated. [ 978.441880] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.442048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.442240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.442347] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.442473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.442635] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92eecac3-3ae8-4ca1-b66e-41a8e0d35650" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.489121] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: SUCCESS [ 978.489336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.489525] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.489719] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.490279] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.490279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.490279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.490279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.490558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.490558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.490558] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.491751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.491751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.491751] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.491751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.492061] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.492061] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.492061] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.492198] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.904645] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.904802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.904873] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.905285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.930056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.930326] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.930451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.930451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.930635] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.931400] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.931400] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 is going to be updated. [ 978.959109] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.959236] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.959421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.959509] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.959942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.969049] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 in Status: IN_PROGRESS for 2s [ 978.994718] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.994881] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.995191] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.159444] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 in Status: SUCCESS [ 979.159723] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 deletion is rescheduled due to dependency. [ 979.159881] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.160160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.160460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.160750] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.160931] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.161022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.161233] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.161352] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.161478] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.161709] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d11ddda-ea1f-4e83-8a8e-a42a470af616 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.161982] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.162103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.162272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.162468] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.162590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.162655] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.162834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.162915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.163034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.163147] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.164138] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.164338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.164504] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.164652] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.164715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.164839] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.164976] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.165656] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.497622] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.669478] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.669478] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.669478] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.669478] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.669478] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.669478] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.669478] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.669478] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.670424] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.670424] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.670424] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 is going to be updated. [ 979.671977] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d11ddda-ea1f-4e83-8a8e-a42a470af616: rpc.has_security_group_logging(os_id): False [ 979.691276] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.691455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.691455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.691683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.691835] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.692026] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.692131] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.692211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.692392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.692470] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.692660] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.692763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.692840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.692993] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.693099] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.693303] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.693410] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.693485] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.693649] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.693725] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.693823] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 is going to be updated. [ 979.705918] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.705918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.705918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.705918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.705918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.719057] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 in Status: IN_PROGRESS for 2s [ 979.787322] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.787322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.787322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.787322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.787322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.813087] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 in Status: IN_PROGRESS for 2s [ 980.002134] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.002134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.002134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.002134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.002134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.002134] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 is going to be updated. [ 980.042782] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.042782] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.042782] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.042782] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.042782] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.053942] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: IN_PROGRESS for 2s [ 980.238326] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 393aa0d3-c462-4737-b799-041054ed8323 in Status: SUCCESS [ 980.238326] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 393aa0d3-c462-4737-b799-041054ed8323 deletion is rescheduled due to dependency. [ 980.238326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-393aa0d3-c462-4737-b799-041054ed8323" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.402073] env[66519]: INFO networking_nsxv3.common.synchronization [req-fc21a29f-7f93-4763-94e0-410711788c79 req-649189e7-39fd-4cb1-8dbb-6704b9126a22 tempest-DeleteServersTestJSON-1278201394 tempest-DeleteServersTestJSON-1278201394-project-member] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 980.402758] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 980.403273] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.403476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.403600] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.403959] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.404226] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.404492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.404622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.404874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.405035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.405193] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.770445] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-42 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.770790] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.770790] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.771265] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.771337] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.771498] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.771615] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.771828] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.771967] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.772377] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 980.772543] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 980.772675] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 980.772847] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 980.772998] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 980.773164] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 980.773326] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 980.793726] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 980.793914] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 980.794069] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 980.794341] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.794681] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-5103b231-793f-491a-90be-3ad0174b8a71 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.794858] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-5103b231-793f-491a-90be-3ad0174b8a71" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.794979] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-5103b231-793f-491a-90be-3ad0174b8a71" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.796022] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-5103b231-793f-491a-90be-3ad0174b8a71" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.796263] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5103b231-793f-491a-90be-3ad0174b8a71',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.910237] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.910405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.910481] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.910697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.910785] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.911106] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.911106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.911212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.911571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.911571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.911571] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e already deleted. [ 980.911571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.979524] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 in Status: SUCCESS [ 980.979730] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb0f115b-2ae8-4ea8-bf0a-99edddaaee58 deletion is rescheduled due to dependency. [ 980.979853] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb0f115b-2ae8-4ea8-bf0a-99edddaaee58" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.299575] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.299773] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.300168] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.300590] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.300780] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.301026] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 5103b231-793f-491a-90be-3ad0174b8a71 not found, creating... [ 981.301375] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.301603] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.301793] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.302100] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.302287] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.302678] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.302889] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.303873] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.304166] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.304352] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.304542] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 5103b231-793f-491a-90be-3ad0174b8a71 is going to be created. [ 981.327707] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.328323] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.328323] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.328554] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.328745] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.329043] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-5103b231-793f-491a-90be-3ad0174b8a71" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.731901] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 in Status: SUCCESS [ 981.732210] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 deletion is rescheduled due to dependency. [ 981.732341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.828898] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 in Status: SUCCESS [ 981.829300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.829438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.829685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.829750] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d11ddda-ea1f-4e83-8a8e-a42a470af616',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.233522] env[66519]: INFO networking_nsxv3.common.synchronization [req-fc21a29f-7f93-4763-94e0-410711788c79 req-07a8e1b4-6ead-44dd-87c4-64699cd89e0a service nova] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_rules [ 982.233771] env[66519]: INFO networking_nsxv3.common.synchronization [req-fc21a29f-7f93-4763-94e0-410711788c79 req-07a8e1b4-6ead-44dd-87c4-64699cd89e0a service nova] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 982.233942] env[66519]: INFO networking_nsxv3.common.synchronization [req-fc21a29f-7f93-4763-94e0-410711788c79 req-07a8e1b4-6ead-44dd-87c4-64699cd89e0a service nova] Enqueued Resource ID: 5103b231-793f-491a-90be-3ad0174b8a71 with Priority: HIGHEST for action port [ 982.234819] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_rules [ 982.234991] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 982.235167] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5103b231-793f-491a-90be-3ad0174b8a71 with Priority: HIGHEST for action port [ 982.235478] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.235629] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.235699] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.235997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.236091] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.237028] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.237028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.237158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.237253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.237637] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.237763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.237807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.237945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.238055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.238149] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.238980] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-5103b231-793f-491a-90be-3ad0174b8a71 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.239112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5103b231-793f-491a-90be-3ad0174b8a71" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.239112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5103b231-793f-491a-90be-3ad0174b8a71" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.239239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5103b231-793f-491a-90be-3ad0174b8a71" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.240133] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5103b231-793f-491a-90be-3ad0174b8a71',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.242519] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: SUCCESS [ 982.242768] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.242920] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.243109] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.243265] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.243369] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.243431] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.243581] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.243674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.243761] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.355889] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.356093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.356093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.357703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.357703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.357703] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d11ddda-ea1f-4e83-8a8e-a42a470af616 is going to be deleted. [ 982.410421] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.410421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.410421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.410421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.410421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.410421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d11ddda-ea1f-4e83-8a8e-a42a470af616" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.741899] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.741899] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.742405] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.742944] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5103b231-793f-491a-90be-3ad0174b8a71 with status ACTIVE [ 982.743613] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.743613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.743613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.743613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.743613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.744079] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.744079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.744079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.744198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.744198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.744922] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.744922] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.744922] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.744922] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.744922] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.744922] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5103b231-793f-491a-90be-3ad0174b8a71 is going to be updated. [ 982.746220] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.770557] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.770697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.770758] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.770983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.771161] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.771370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5103b231-793f-491a-90be-3ad0174b8a71" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.248013] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.250905] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.751213] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.751441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.751441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.751645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.751732] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.751832] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be created. [ 983.753398] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.753521] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.753590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.753761] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.753842] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.753930] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 is going to be updated. [ 983.790066] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.792025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.792025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.792025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.792025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.793557] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.793877] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.794050] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.794333] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.794571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.802814] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: IN_PROGRESS for 2s [ 983.803894] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: UNINITIALIZED for 2s [ 983.872299] env[66519]: INFO networking_nsxv3.common.synchronization [req-60406cce-3ebd-4f52-a0fd-0706ffa2c61a req-94eea13e-5f2b-4167-af1e-42882f553d4d tempest-ServerActionsTestOtherA-1261634680 tempest-ServerActionsTestOtherA-1261634680-project-member] Enqueued Resource ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 with Priority: HIGHEST for action security_group_members [ 983.873011] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 with Priority: HIGHEST for action security_group_members [ 983.873695] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-9619a08c-5035-47ce-91cf-089cdb9ae303 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.873803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.873803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.874048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.874215] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.874336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.874474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.874684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.874798] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.874892] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9619a08c-5035-47ce-91cf-089cdb9ae303',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.226466] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-320 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.226690] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.226810] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.227239] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.227533] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.227710] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.227831] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.228115] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.228289] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.228543] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 984.228653] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 984.228764] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 984.228890] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 984.229013] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 984.229131] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 984.232450] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 984.249567] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 984.249968] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 984.250446] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 984.250619] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.251106] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-41af34f0-2a7f-476a-adac-1e7e5d0eeac0 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.251394] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-41af34f0-2a7f-476a-adac-1e7e5d0eeac0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.251580] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-41af34f0-2a7f-476a-adac-1e7e5d0eeac0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.251973] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-41af34f0-2a7f-476a-adac-1e7e5d0eeac0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.252188] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41af34f0-2a7f-476a-adac-1e7e5d0eeac0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.379242] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.379519] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.379602] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.379868] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.379970] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.380194] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.380315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.380352] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.380525] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.380602] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.380686] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 already deleted. [ 984.380763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.754655] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.754947] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.755146] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.755438] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.755587] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.755763] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 41af34f0-2a7f-476a-adac-1e7e5d0eeac0 not found, creating... [ 984.756047] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.756241] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.756376] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.756594] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.756729] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.757014] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.757171] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.757317] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.757528] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.757660] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.757795] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 41af34f0-2a7f-476a-adac-1e7e5d0eeac0 is going to be created. [ 984.788110] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.788396] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.788497] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.788768] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.788998] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.789232] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-41af34f0-2a7f-476a-adac-1e7e5d0eeac0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.526171] env[66519]: INFO networking_nsxv3.common.synchronization [req-60406cce-3ebd-4f52-a0fd-0706ffa2c61a req-a9855bfa-5a77-49e2-af17-7b8c542c6e13 service nova] Enqueued Resource ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 with Priority: HIGHEST for action security_group_rules [ 985.526171] env[66519]: INFO networking_nsxv3.common.synchronization [req-60406cce-3ebd-4f52-a0fd-0706ffa2c61a req-a9855bfa-5a77-49e2-af17-7b8c542c6e13 service nova] Enqueued Resource ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 with Priority: HIGHEST for action security_group_members [ 985.526171] env[66519]: INFO networking_nsxv3.common.synchronization [req-60406cce-3ebd-4f52-a0fd-0706ffa2c61a req-a9855bfa-5a77-49e2-af17-7b8c542c6e13 service nova] Enqueued Resource ID: 41af34f0-2a7f-476a-adac-1e7e5d0eeac0 with Priority: HIGHEST for action port [ 985.526605] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 with Priority: HIGHEST for action security_group_rules [ 985.526883] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 with Priority: HIGHEST for action security_group_members [ 985.526883] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41af34f0-2a7f-476a-adac-1e7e5d0eeac0 with Priority: HIGHEST for action port [ 985.527262] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9619a08c-5035-47ce-91cf-089cdb9ae303 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.527411] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.527460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.527658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.527986] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9619a08c-5035-47ce-91cf-089cdb9ae303',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.529467] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-9619a08c-5035-47ce-91cf-089cdb9ae303 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.529467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.529467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.529467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.529467] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.529467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.529467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.529891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.529891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.529891] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9619a08c-5035-47ce-91cf-089cdb9ae303',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.530982] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-41af34f0-2a7f-476a-adac-1e7e5d0eeac0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.531165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41af34f0-2a7f-476a-adac-1e7e5d0eeac0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.531288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41af34f0-2a7f-476a-adac-1e7e5d0eeac0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.532197] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41af34f0-2a7f-476a-adac-1e7e5d0eeac0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.532197] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41af34f0-2a7f-476a-adac-1e7e5d0eeac0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.817078] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: SUCCESS [ 985.817078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.817078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.817516] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.817516] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.817630] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.817685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.817878] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.817960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.818057] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.818237] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.818322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.818414] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.818526] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.818710] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.818806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.818865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.819015] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.819094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.819176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.819292] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.821073] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 985.821267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.821460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.821657] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.821834] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.821966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.822057] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.822205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.822281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.822363] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.822515] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.033933] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-9619a08c-5035-47ce-91cf-089cdb9ae303 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.033933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.034130] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9619a08c-5035-47ce-91cf-089cdb9ae303',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.034941] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41af34f0-2a7f-476a-adac-1e7e5d0eeac0 with status ACTIVE [ 986.035200] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.035260] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.035328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.035540] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.035627] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.035803] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.035892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.036021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.036680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.036680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.036680] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.036680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.036680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.036680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.036680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.036976] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41af34f0-2a7f-476a-adac-1e7e5d0eeac0 is going to be updated. [ 986.069107] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.069107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.069107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.069107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.069683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.069683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41af34f0-2a7f-476a-adac-1e7e5d0eeac0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.323904] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4: rpc.has_security_group_logging(os_id): False [ 986.325310] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.325514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.325514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.325732] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.326347] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.326456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.326515] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.326783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.326783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.326911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.327071] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.327181] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.327283] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.327430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.327571] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.327663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.327721] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.327870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.327913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.328016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.328163] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.349647] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.349784] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.349855] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.350079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.350166] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.350386] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.350487] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.350603] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.350696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.350771] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.350947] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.351052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.351112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.351255] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.351330] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.351499] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.351588] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.351645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.351778] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.351848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.351932] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 is going to be created. [ 986.372585] env[66519]: INFO networking_nsxv3.common.synchronization [req-17767e47-fad6-4258-a73f-22c8dda26110 req-818c6ee7-b256-4a0a-a977-327a75c0642d tempest-ServersTestJSON-971253557 tempest-ServersTestJSON-971253557-project-member] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 986.373250] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 986.374174] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.374174] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.374174] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.374174] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.374425] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.374425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.374568] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.374616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.374688] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.374807] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.420515] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.420708] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.420708] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.420823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.420998] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.432063] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: IN_PROGRESS for 2s [ 986.539149] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9619a08c-5035-47ce-91cf-089cdb9ae303',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.736655] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-450 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.736845] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.736963] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.737258] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.737543] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.737714] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.737827] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.738167] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.738363] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.738573] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.738683] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.738826] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.738883] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.738979] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 986.739092] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.739218] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.758396] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.758551] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 986.758689] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.758854] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.759179] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-c7ccdede-75bb-40b8-b397-fd5baa970969 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.759350] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-c7ccdede-75bb-40b8-b397-fd5baa970969" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.759499] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-c7ccdede-75bb-40b8-b397-fd5baa970969" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.759836] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-c7ccdede-75bb-40b8-b397-fd5baa970969" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.759973] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7ccdede-75bb-40b8-b397-fd5baa970969',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.830392] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 811de0c5-86ee-4ef7-afc3-0946a87f0b2e: rpc.has_security_group_logging(os_id): False [ 986.849086] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.849255] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.849313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.849525] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.849620] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.849841] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.849942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.850017] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.850170] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.850248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.850435] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.850521] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.850576] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.850713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.850782] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.850965] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.851069] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.851128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.851265] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.851336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.851418] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be created. [ 986.877625] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.911419] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.911419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.911419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.911419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.911419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.926247] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 987.042575] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.042774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.042848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.043096] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.043195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.043304] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 is going to be created. [ 987.066485] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.066606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.066778] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.066903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.067081] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.077381] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 in Status: UNINITIALIZED for 2s [ 987.262069] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.262331] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.262457] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.262780] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.262943] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.263136] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port c7ccdede-75bb-40b8-b397-fd5baa970969 not found, creating... [ 987.263392] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.263545] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.263658] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.263892] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.264132] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.264298] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.264445] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.264553] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.264750] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.264876] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.265025] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: c7ccdede-75bb-40b8-b397-fd5baa970969 is going to be created. [ 987.301908] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.302163] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.302310] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.302617] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.302981] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.303267] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-c7ccdede-75bb-40b8-b397-fd5baa970969" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.380412] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.882789] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.883126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.883126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.883267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.883359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.883471] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 987.915146] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.915843] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.915843] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.915843] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.915843] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.925750] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 988.025864] env[66519]: INFO networking_nsxv3.common.synchronization [req-17767e47-fad6-4258-a73f-22c8dda26110 req-2b488a86-c96e-4951-92ac-aa225a561037 service nova] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_rules [ 988.025864] env[66519]: INFO networking_nsxv3.common.synchronization [req-17767e47-fad6-4258-a73f-22c8dda26110 req-2b488a86-c96e-4951-92ac-aa225a561037 service nova] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 988.025864] env[66519]: INFO networking_nsxv3.common.synchronization [req-17767e47-fad6-4258-a73f-22c8dda26110 req-2b488a86-c96e-4951-92ac-aa225a561037 service nova] Enqueued Resource ID: c7ccdede-75bb-40b8-b397-fd5baa970969 with Priority: HIGHEST for action port [ 988.026715] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_rules [ 988.026715] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 988.026784] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7ccdede-75bb-40b8-b397-fd5baa970969 with Priority: HIGHEST for action port [ 988.027858] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.027858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.027858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.027858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.027858] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.028654] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.029680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.029680] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7ccdede-75bb-40b8-b397-fd5baa970969 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.029680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7ccdede-75bb-40b8-b397-fd5baa970969" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.029680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7ccdede-75bb-40b8-b397-fd5baa970969" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.029680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7ccdede-75bb-40b8-b397-fd5baa970969" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.029680] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7ccdede-75bb-40b8-b397-fd5baa970969',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.444469] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: SUCCESS [ 988.444749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.444942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.445296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.445404] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.535284] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.535284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.535284] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7ccdede-75bb-40b8-b397-fd5baa970969 with status ACTIVE [ 988.535284] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.535284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.535284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.535284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.535284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.535284] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.535284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.535284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.535284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.535284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.535284] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.536135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.536135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.536135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.536135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.536888] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7ccdede-75bb-40b8-b397-fd5baa970969 is going to be updated. [ 988.564264] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.564526] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.564526] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.565153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.565153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.565153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7ccdede-75bb-40b8-b397-fd5baa970969" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.939773] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 988.940074] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.948038] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.948309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.948753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.949046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.949306] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.949581] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.949581] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.949899] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.950054] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.950217] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.950519] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.090185] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 in Status: SUCCESS [ 989.090397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.090566] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.090786] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.090982] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.091110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.091190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.091312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.091402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.091491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.091573] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9619a08c-5035-47ce-91cf-089cdb9ae303',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.453642] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.453880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.453978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.454331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.454593] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.454744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.454851] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.455164] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.455308] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.455496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.455684] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.455795] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.455857] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.456213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.456213] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.456361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.456436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.456658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.456770] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.456915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.457115] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.594547] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9619a08c-5035-47ce-91cf-089cdb9ae303',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.941783] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 989.941783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.941783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.941783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.941783] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.941783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.941783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.941783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.941783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.941783] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.961476] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4: rpc.has_security_group_logging(os_id): False [ 989.983227] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.983484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.983484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.983973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.983973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.984563] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.984654] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.984772] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.985044] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.985280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.985668] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.985767] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.985805] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.986022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.986169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.986413] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.986603] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.986804] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.986974] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.987190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.987400] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 is going to be updated. [ 990.084610] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.084888] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.084960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.085592] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.085748] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.099779] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9619a08c-5035-47ce-91cf-089cdb9ae303: rpc.has_security_group_logging(os_id): False [ 990.116448] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: IN_PROGRESS for 2s [ 990.131385] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.133077] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.133077] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.133273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.133305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.133730] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.133888] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.134161] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.134413] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.134538] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.135148] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 is going to be created. [ 990.262488] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.262696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.262803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.263105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.263414] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.281106] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 in Status: IN_PROGRESS for 2s [ 990.443832] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.815636] env[66519]: INFO networking_nsxv3.common.synchronization [req-9bb4cd1a-aa3b-4578-bdb8-da8327c47977 req-ceebca4b-0857-4f6f-a882-1968c2080843 tempest-ImagesTestJSON-1420515381 tempest-ImagesTestJSON-1420515381-project-member] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 990.816754] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 990.816754] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.816754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.816754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.817120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.817314] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.817439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.817511] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.817681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.817766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.817914] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.947634] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.320499] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.321495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.321495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.321820] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.357532] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.357897] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.358021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.358094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.358340] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.358430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.358692] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be updated. [ 991.420260] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.420450] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.420450] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.420685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.420831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.440147] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: IN_PROGRESS for 2s [ 991.450971] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.451169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.451271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.451536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.451648] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.452047] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 991.521704] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.521981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.521981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.522843] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.522843] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.539058] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 992.130463] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: SUCCESS [ 992.130847] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.308474] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 in Status: SUCCESS [ 992.308830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.823591] env[66519]: INFO networking_nsxv3.common.synchronization [req-666d4313-a915-4024-92bf-5a9e8cbf4d67 req-cacb2a59-4bd9-4893-a414-dbf83caeb88d tempest-DeleteServersTestJSON-1278201394 tempest-DeleteServersTestJSON-1278201394-project-member] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 992.823761] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 992.824154] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.825613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.825613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.825613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.825613] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.825613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.825613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.825613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.825613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.825613] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.327915] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.328279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.328279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.328443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.328483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.328687] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.328800] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.328913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.328992] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.329071] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.329196] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 993.362212] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.362392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.362444] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.362653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.362838] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.372849] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 993.451743] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: SUCCESS [ 993.451971] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 deletion is rescheduled due to dependency. [ 993.452126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.551723] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 993.554018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.554018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.554018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.554018] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.554018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.554018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.554018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.554018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.554018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.554018] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.055999] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.056201] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.056267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.056556] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.056674] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.056773] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.056871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.056951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.057106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.057269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.057531] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.057531] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.057696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.057757] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.057840] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.057925] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.057985] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.058120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.058270] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.058325] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.058508] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.561788] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb1cadf6-d26e-4714-b83e-0fcbe235e2e5: rpc.has_security_group_logging(os_id): False [ 994.583115] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.583268] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.583335] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.584585] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.605261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.605451] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.605581] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.605646] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.605913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.605961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.606177] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.606281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.606342] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.606485] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.606555] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.606752] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.606879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.606967] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.607172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.607277] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.607356] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 994.682418] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.682607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.682647] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.682982] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.683153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.697031] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 995.385921] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 995.385921] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e deletion is rescheduled due to dependency. [ 995.385921] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.714275] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 996.714275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.825469] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 997.825742] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1001.811979] env[66519]: INFO networking_nsxv3.common.synchronization [req-67b5a482-8027-4bcc-85ac-ccd8c27ddd79 req-1274efd2-b62d-4db4-b420-f7bffc303a15 tempest-ServersAdminTestJSON-863383517 tempest-ServersAdminTestJSON-863383517-project-member] Enqueued Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 1001.811979] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 1001.811979] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.811979] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.811979] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.812663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.812663] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.812663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.812663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.812663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.812663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.813016] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.920603] env[66519]: INFO networking_nsxv3.common.synchronization [None req-b3b4d61a-1347-4a55-ab36-af82a244c8c7 None None] Enqueued Resource ID: ebd0cd8a-75bd-44ac-933b-67749eee14d7 with Priority: HIGHEST for action port [ 1001.922550] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebd0cd8a-75bd-44ac-933b-67749eee14d7 with Priority: HIGHEST for action port [ 1001.923086] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebd0cd8a-75bd-44ac-933b-67749eee14d7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.923288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebd0cd8a-75bd-44ac-933b-67749eee14d7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.923415] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebd0cd8a-75bd-44ac-933b-67749eee14d7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.923789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebd0cd8a-75bd-44ac-933b-67749eee14d7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.923939] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebd0cd8a-75bd-44ac-933b-67749eee14d7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.233666] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-314 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.234494] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.234655] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.234934] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.235217] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.235381] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.235499] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.236009] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.236009] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.237638] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1002.237638] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1002.237638] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1002.237638] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1002.237638] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1002.237638] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1002.237638] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1002.259488] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1002.259603] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1002.259781] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1002.259978] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.260319] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-bc098cda-1fd2-45b4-b009-18c41a6f6582 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.260489] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-bc098cda-1fd2-45b4-b009-18c41a6f6582" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.260604] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-bc098cda-1fd2-45b4-b009-18c41a6f6582" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.260924] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-bc098cda-1fd2-45b4-b009-18c41a6f6582" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.261074] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc098cda-1fd2-45b4-b009-18c41a6f6582',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.315691] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.429174] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebd0cd8a-75bd-44ac-933b-67749eee14d7 [ 1002.430076] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.430076] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.430076] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.430076] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.430076] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.430076] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebd0cd8a-75bd-44ac-933b-67749eee14d7 already deleted. [ 1002.430076] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebd0cd8a-75bd-44ac-933b-67749eee14d7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.765447] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.765447] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.765447] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.765447] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.765447] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.765447] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port bc098cda-1fd2-45b4-b009-18c41a6f6582 not found, creating... [ 1002.765802] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.765802] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.765896] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.766135] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.766270] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.766560] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.767735] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.767735] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.767735] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.767735] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.767735] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: bc098cda-1fd2-45b4-b009-18c41a6f6582 is going to be created. [ 1002.789011] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.789236] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.789467] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.789674] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.789919] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.790154] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-bc098cda-1fd2-45b4-b009-18c41a6f6582" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.819972] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.936869] env[66519]: INFO networking_nsxv3.common.synchronization [None req-f61a78ee-c5b8-403e-974d-298151ba8435 tempest-AttachVolumeNegativeTest-1001897465 tempest-AttachVolumeNegativeTest-1001897465-project-member] Enqueued Resource ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 with Priority: HIGHEST for action security_group_rules [ 1002.937425] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 with Priority: HIGHEST for action security_group_rules [ 1002.939400] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.939400] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.939617] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.939714] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.939799] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e5e7bc4-c260-4f47-9e3e-5384e5bb5347',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.321402] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.321569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.321641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.322275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.322275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.322275] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 is going to be updated. [ 1003.367416] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.367603] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.367717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.367886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.368030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.378864] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: IN_PROGRESS for 2s [ 1003.462724] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.463245] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.463245] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.464203] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.464246] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.464322] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 already deleted. [ 1003.464445] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.537374] env[66519]: INFO networking_nsxv3.common.synchronization [req-67b5a482-8027-4bcc-85ac-ccd8c27ddd79 req-6519587c-64ca-4f08-bac8-49298eadaa7f service nova] Enqueued Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_rules [ 1003.537374] env[66519]: INFO networking_nsxv3.common.synchronization [req-67b5a482-8027-4bcc-85ac-ccd8c27ddd79 req-6519587c-64ca-4f08-bac8-49298eadaa7f service nova] Enqueued Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 1003.537374] env[66519]: INFO networking_nsxv3.common.synchronization [req-67b5a482-8027-4bcc-85ac-ccd8c27ddd79 req-6519587c-64ca-4f08-bac8-49298eadaa7f service nova] Enqueued Resource ID: bc098cda-1fd2-45b4-b009-18c41a6f6582 with Priority: HIGHEST for action port [ 1003.537374] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_rules [ 1003.537374] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 1003.537374] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc098cda-1fd2-45b4-b009-18c41a6f6582 with Priority: HIGHEST for action port [ 1003.537374] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.537374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.538060] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.539155] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.539155] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.539695] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.539695] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.539881] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc098cda-1fd2-45b4-b009-18c41a6f6582 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.539977] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc098cda-1fd2-45b4-b009-18c41a6f6582" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.540333] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc098cda-1fd2-45b4-b009-18c41a6f6582" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.540520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc098cda-1fd2-45b4-b009-18c41a6f6582" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.540594] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc098cda-1fd2-45b4-b009-18c41a6f6582',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.626027] env[66519]: INFO networking_nsxv3.common.synchronization [None req-e88482e2-650c-438e-9921-3c13565b432d tempest-AttachVolumeNegativeTest-1001897465 tempest-AttachVolumeNegativeTest-1001897465-project-member] Enqueued Resource ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 with Priority: HIGHEST for action security_group_rules [ 1003.626027] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 with Priority: HIGHEST for action security_group_rules [ 1003.626027] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.626027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.626027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.626027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.626027] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e5e7bc4-c260-4f47-9e3e-5384e5bb5347',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.042954] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.042954] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.046801] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc098cda-1fd2-45b4-b009-18c41a6f6582 with status ACTIVE [ 1004.046801] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.046801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.046801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.046801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.046801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.046801] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.046801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.046801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.046801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.046801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.046801] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.046801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.046801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.047563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.047563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.047563] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc098cda-1fd2-45b4-b009-18c41a6f6582 is going to be updated. [ 1004.072102] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.072711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.072791] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.073014] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.073171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.073334] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc098cda-1fd2-45b4-b009-18c41a6f6582" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.146765] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.146897] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.148108] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.148108] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.148108] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.148108] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 already deleted. [ 1004.148108] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.291700] env[66519]: INFO networking_nsxv3.common.synchronization [None req-cdc5cd85-477e-49f9-a801-fc97193584e2 None None] Enqueued Resource ID: 7ae9df0a-24e3-4dbe-a96c-0e04693def80 with Priority: HIGHEST for action port [ 1004.292313] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ae9df0a-24e3-4dbe-a96c-0e04693def80 with Priority: HIGHEST for action port [ 1004.292620] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ae9df0a-24e3-4dbe-a96c-0e04693def80 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.294010] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ae9df0a-24e3-4dbe-a96c-0e04693def80" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.295278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ae9df0a-24e3-4dbe-a96c-0e04693def80" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.295278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ae9df0a-24e3-4dbe-a96c-0e04693def80" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.295278] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ae9df0a-24e3-4dbe-a96c-0e04693def80',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.544136] env[66519]: INFO networking_nsxv3.common.synchronization [req-7b6999d6-fb2c-4d2f-b8f0-75a25cebcae1 req-e8317f2b-25c4-4469-91b6-44612c1ddb5f tempest-ImagesTestJSON-1420515381 tempest-ImagesTestJSON-1420515381-project-member] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 1004.544676] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 1004.544964] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.545100] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.545166] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.545444] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.545601] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.545717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.545757] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.545900] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.545983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.547159] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.799960] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ae9df0a-24e3-4dbe-a96c-0e04693def80 [ 1004.799960] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.799960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.799960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.799960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.800314] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.800422] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ae9df0a-24e3-4dbe-a96c-0e04693def80 already deleted. [ 1004.800468] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ae9df0a-24e3-4dbe-a96c-0e04693def80" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.052957] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.053298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.053298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.053444] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.053538] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.053750] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.053864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.053919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.054053] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.054137] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.054226] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be updated. [ 1005.086567] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.086773] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.086773] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.087060] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.087060] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.098990] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: IN_PROGRESS for 2s [ 1005.393644] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: SUCCESS [ 1005.393964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.394294] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.394409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.394823] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.394823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.394823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.395072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.395072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.395189] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.467769] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-161 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.468601] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.468601] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.468601] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.468919] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.469492] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.469492] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.469492] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.469492] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.470604] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.470604] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1005.470604] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1005.470604] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1005.470604] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.470604] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1005.470604] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1005.494040] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1005.494040] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1005.494040] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1005.494040] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-161" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.494314] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-7e02c998-9aef-4d58-b4f0-89b6a8334a08 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.494314] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-7e02c998-9aef-4d58-b4f0-89b6a8334a08" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.494456] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-7e02c998-9aef-4d58-b4f0-89b6a8334a08" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.494776] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-7e02c998-9aef-4d58-b4f0-89b6a8334a08" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.494904] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e02c998-9aef-4d58-b4f0-89b6a8334a08',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.807592] env[66519]: INFO networking_nsxv3.common.synchronization [None req-05ccef4e-6b7e-452f-b0de-caa74e4def3c None None] Enqueued Resource ID: dddc80e2-2d69-4b04-9f9c-7396c6b97f42 with Priority: HIGHEST for action port [ 1005.808889] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dddc80e2-2d69-4b04-9f9c-7396c6b97f42 with Priority: HIGHEST for action port [ 1005.808889] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-dddc80e2-2d69-4b04-9f9c-7396c6b97f42 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.808889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dddc80e2-2d69-4b04-9f9c-7396c6b97f42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.808889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dddc80e2-2d69-4b04-9f9c-7396c6b97f42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.808889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dddc80e2-2d69-4b04-9f9c-7396c6b97f42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.809155] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dddc80e2-2d69-4b04-9f9c-7396c6b97f42',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.898249] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.998769] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.000834] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.000834] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.000834] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.000834] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.000834] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 7e02c998-9aef-4d58-b4f0-89b6a8334a08 not found, creating... [ 1006.000834] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.000834] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.000834] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.000834] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.001399] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.001399] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.001494] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.002072] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.002072] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.002072] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.002072] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 7e02c998-9aef-4d58-b4f0-89b6a8334a08 is going to be created. [ 1006.029082] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.029291] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.029470] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.029752] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.029975] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.030319] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-7e02c998-9aef-4d58-b4f0-89b6a8334a08" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.310901] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dddc80e2-2d69-4b04-9f9c-7396c6b97f42 [ 1006.311207] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.311314] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.311383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.311606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.311691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.311805] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dddc80e2-2d69-4b04-9f9c-7396c6b97f42 already deleted. [ 1006.311934] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dddc80e2-2d69-4b04-9f9c-7396c6b97f42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.403279] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.627573] env[66519]: INFO networking_nsxv3.common.synchronization [None req-0e7eb0a6-a0c5-463b-bbe6-6c32ecef8d3a None None] Enqueued Resource ID: b8bb0976-5766-4486-9fcc-da9df275c6b1 with Priority: HIGHEST for action port [ 1006.628220] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8bb0976-5766-4486-9fcc-da9df275c6b1 with Priority: HIGHEST for action port [ 1006.628572] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8bb0976-5766-4486-9fcc-da9df275c6b1 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.628738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8bb0976-5766-4486-9fcc-da9df275c6b1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.629587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8bb0976-5766-4486-9fcc-da9df275c6b1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.629587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8bb0976-5766-4486-9fcc-da9df275c6b1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.629587] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8bb0976-5766-4486-9fcc-da9df275c6b1',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.826987] env[66519]: INFO networking_nsxv3.common.synchronization [req-7b6999d6-fb2c-4d2f-b8f0-75a25cebcae1 req-c0b519c1-1b77-4782-acfe-297d2def6064 service nova] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_rules [ 1006.827258] env[66519]: INFO networking_nsxv3.common.synchronization [req-7b6999d6-fb2c-4d2f-b8f0-75a25cebcae1 req-c0b519c1-1b77-4782-acfe-297d2def6064 service nova] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 1006.827474] env[66519]: INFO networking_nsxv3.common.synchronization [req-7b6999d6-fb2c-4d2f-b8f0-75a25cebcae1 req-c0b519c1-1b77-4782-acfe-297d2def6064 service nova] Enqueued Resource ID: 7e02c998-9aef-4d58-b4f0-89b6a8334a08 with Priority: HIGHEST for action port [ 1006.828276] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_rules [ 1006.828771] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 1006.828919] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e02c998-9aef-4d58-b4f0-89b6a8334a08 with Priority: HIGHEST for action port [ 1006.829350] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.829561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.829629] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.829932] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.830074] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.831222] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.831382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.831724] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e02c998-9aef-4d58-b4f0-89b6a8334a08 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.831858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e02c998-9aef-4d58-b4f0-89b6a8334a08" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.831958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e02c998-9aef-4d58-b4f0-89b6a8334a08" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.833083] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e02c998-9aef-4d58-b4f0-89b6a8334a08" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.833083] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e02c998-9aef-4d58-b4f0-89b6a8334a08',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.907613] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.907613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.907613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.907846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.907846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.907915] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 is going to be updated. [ 1006.935350] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.935591] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.935675] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.935903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.936230] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.946347] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: IN_PROGRESS for 2s [ 1007.112395] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: SUCCESS [ 1007.112617] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 deletion is rescheduled due to dependency. [ 1007.112765] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.113278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.113764] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.113764] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.113764] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.113926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.113966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.114296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.114296] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.131424] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8bb0976-5766-4486-9fcc-da9df275c6b1 [ 1007.131752] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.131933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.132013] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.132241] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.132559] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.132704] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8bb0976-5766-4486-9fcc-da9df275c6b1 already deleted. [ 1007.132895] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8bb0976-5766-4486-9fcc-da9df275c6b1" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.335617] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.335961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.335961] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e02c998-9aef-4d58-b4f0-89b6a8334a08 with status ACTIVE [ 1007.336750] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.336750] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.336750] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.336750] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.336750] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.336750] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.337037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.337037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.337037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.337183] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.337346] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.337438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.337500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.337695] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.337766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.337857] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e02c998-9aef-4d58-b4f0-89b6a8334a08 is going to be updated. [ 1007.363826] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.364032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.364032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.364211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.364434] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.365037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e02c998-9aef-4d58-b4f0-89b6a8334a08" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.617231] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.122877] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.625142] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.627192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.627192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.627192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.627192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.627192] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be updated. [ 1008.662015] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.662015] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.662015] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.662015] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.662295] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.672534] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: IN_PROGRESS for 2s [ 1008.957020] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: SUCCESS [ 1008.957020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.957020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.957199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.957434] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.957590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.957680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.957850] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.957953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.958027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.958124] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.464762] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.464976] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.465037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.465283] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.465467] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.465574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.465635] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.465810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.465898] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.465988] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.466150] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.466242] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.466304] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.466444] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.466584] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.466674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.466732] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.466867] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.466942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.467031] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.467120] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.970091] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4: rpc.has_security_group_logging(os_id): False [ 1009.993878] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.994038] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.994116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.994330] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.994440] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.994699] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.994810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.994872] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.995098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.995170] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.995577] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.995695] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.995764] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.995938] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.996061] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.996296] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.996398] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.996540] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.996711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.996805] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.996973] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 is going to be updated. [ 1010.085010] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.085153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.085721] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.085721] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.085721] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.100294] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: IN_PROGRESS for 2s [ 1010.684468] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: SUCCESS [ 1010.684700] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.684876] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.685243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.685328] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.685438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.685534] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.685714] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.685797] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.685886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.685979] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.990831] env[66519]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1010.991471] env[66519]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1011.190289] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.190289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.190289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.190289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.190289] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.190289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.190289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.190289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.190289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.190289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.190729] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.190729] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.190729] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.190729] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.190864] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.190941] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.191009] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.191150] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.191236] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.191325] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.191573] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.694562] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c93d149b-db2a-420d-81f5-177c6bdd9505: rpc.has_security_group_logging(os_id): False [ 1011.714463] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.714610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.714689] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.714899] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.714990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.715201] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.715313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.715385] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.715661] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.715661] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.715810] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.715898] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.715970] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.716146] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.716224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.716419] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.716520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.716577] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.716717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.716791] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.716872] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be updated. [ 1011.792340] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.792543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.792621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.792874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.793082] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.809330] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: IN_PROGRESS for 2s [ 1011.831407] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1011.831534] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1012.116100] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: SUCCESS [ 1012.116448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.459804] env[66519]: INFO networking_nsxv3.common.synchronization [req-34f937df-145b-4172-88bd-3f3019f872a0 req-374d5d11-48b7-46b0-90b4-311c7e1171df tempest-ServersTestJSON-971253557 tempest-ServersTestJSON-971253557-project-member] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1012.460904] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1012.461367] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.461491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.461565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.461800] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.461914] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.462036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.462123] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.462237] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.462333] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.462429] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.839717] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-450 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.839962] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.840159] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.840444] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.840777] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.840987] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.841155] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.841403] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.841582] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.841815] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.841952] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.842096] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.842236] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.842375] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.842525] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.842685] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.861328] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.861496] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1012.861631] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.861818] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.862154] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-95878ab0-ce06-469b-9b3b-d2480d6c883d taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.862320] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-95878ab0-ce06-469b-9b3b-d2480d6c883d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.862437] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-95878ab0-ce06-469b-9b3b-d2480d6c883d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.862807] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-95878ab0-ce06-469b-9b3b-d2480d6c883d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.863166] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95878ab0-ce06-469b-9b3b-d2480d6c883d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.969277] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.366162] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.366524] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.366524] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.366775] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.366923] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.367090] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 95878ab0-ce06-469b-9b3b-d2480d6c883d not found, creating... [ 1013.367347] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.367577] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.367669] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.367863] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.368010] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.368292] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.368464] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.368620] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.368838] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.369103] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.369103] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 95878ab0-ce06-469b-9b3b-d2480d6c883d is going to be created. [ 1013.391289] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.391536] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.391670] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.392010] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.392290] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.392520] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-95878ab0-ce06-469b-9b3b-d2480d6c883d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.471745] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.823302] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: SUCCESS [ 1013.823429] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.974093] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.974319] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.974426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.974664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.974803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.974951] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 1014.005432] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.005652] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.005801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.005910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.006069] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.016556] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 1014.137946] env[66519]: INFO networking_nsxv3.common.synchronization [req-34f937df-145b-4172-88bd-3f3019f872a0 req-4c26f0ed-b412-4d13-9a15-5919d9657317 service nova] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_rules [ 1014.138140] env[66519]: INFO networking_nsxv3.common.synchronization [req-34f937df-145b-4172-88bd-3f3019f872a0 req-4c26f0ed-b412-4d13-9a15-5919d9657317 service nova] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1014.138296] env[66519]: INFO networking_nsxv3.common.synchronization [req-34f937df-145b-4172-88bd-3f3019f872a0 req-4c26f0ed-b412-4d13-9a15-5919d9657317 service nova] Enqueued Resource ID: 95878ab0-ce06-469b-9b3b-d2480d6c883d with Priority: HIGHEST for action port [ 1014.138840] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_rules [ 1014.138965] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1014.142182] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95878ab0-ce06-469b-9b3b-d2480d6c883d with Priority: HIGHEST for action port [ 1014.142182] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.142182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.142182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.142182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.142182] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.142182] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.142182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.142182] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-95878ab0-ce06-469b-9b3b-d2480d6c883d taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.142182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95878ab0-ce06-469b-9b3b-d2480d6c883d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.142588] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95878ab0-ce06-469b-9b3b-d2480d6c883d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.142588] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95878ab0-ce06-469b-9b3b-d2480d6c883d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.142588] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95878ab0-ce06-469b-9b3b-d2480d6c883d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.645043] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.645043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.645043] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95878ab0-ce06-469b-9b3b-d2480d6c883d with status ACTIVE [ 1014.645467] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.645467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.645467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.645999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.645999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.645999] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.646185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.646185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.646379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.646543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.646746] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.646842] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.646901] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.647173] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.647173] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.647278] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95878ab0-ce06-469b-9b3b-d2480d6c883d is going to be updated. [ 1014.667704] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.667859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.667931] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.668152] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.668284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.668464] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95878ab0-ce06-469b-9b3b-d2480d6c883d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.964661] env[66519]: INFO networking_nsxv3.common.synchronization [req-81dca375-3a02-47a3-809d-b82df49c8267 req-dfc9ebe0-1e36-43bf-8a9e-c29206d29198 tempest-AttachVolumeNegativeTest-1001897465 tempest-AttachVolumeNegativeTest-1001897465-project-member] Enqueued Resource ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 with Priority: HIGHEST for action security_group_members [ 1014.965443] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 with Priority: HIGHEST for action security_group_members [ 1014.965499] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.965612] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.965678] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.965916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.967027] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.967171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.967265] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.967430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.967552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.967620] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e5e7bc4-c260-4f47-9e3e-5384e5bb5347',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.289995] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-322 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.290162] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-322" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.290318] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-322" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.290683] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-322" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.290978] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.293373] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.293522] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.293809] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.293966] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.294204] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.294315] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.294422] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.294527] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.294635] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.294732] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.294872] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.317268] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.317445] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1015.317602] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.317796] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-322" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.318387] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-27e2a0fd-bbdf-458c-9dd1-4c80cd7b320b taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.318387] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-27e2a0fd-bbdf-458c-9dd1-4c80cd7b320b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.318541] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-27e2a0fd-bbdf-458c-9dd1-4c80cd7b320b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.318775] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-27e2a0fd-bbdf-458c-9dd1-4c80cd7b320b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.318915] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27e2a0fd-bbdf-458c-9dd1-4c80cd7b320b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.470537] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.470703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.470783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.471013] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.472267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.472524] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.472638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.472700] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.472892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.472970] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.473077] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 already deleted. [ 1015.473155] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.822734] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.823050] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.823132] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.823440] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.823595] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.823783] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 27e2a0fd-bbdf-458c-9dd1-4c80cd7b320b not found, creating... [ 1015.824079] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.824260] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.824393] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.824647] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.824798] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.825134] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.825346] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.825533] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.825781] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.825929] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.826094] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 27e2a0fd-bbdf-458c-9dd1-4c80cd7b320b is going to be created. [ 1015.850042] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.850042] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.850271] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.850449] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.850807] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.851462] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-27e2a0fd-bbdf-458c-9dd1-4c80cd7b320b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.028156] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 1016.028498] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.028761] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.029168] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.029407] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.029612] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.029767] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.029989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.030131] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.030305] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.534242] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.552367] env[66519]: INFO networking_nsxv3.common.synchronization [req-81dca375-3a02-47a3-809d-b82df49c8267 req-9236b3a9-fc18-403e-83a2-ed26cbd3a1b3 service nova] Enqueued Resource ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 with Priority: HIGHEST for action security_group_rules [ 1016.552530] env[66519]: INFO networking_nsxv3.common.synchronization [req-81dca375-3a02-47a3-809d-b82df49c8267 req-9236b3a9-fc18-403e-83a2-ed26cbd3a1b3 service nova] Enqueued Resource ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 with Priority: HIGHEST for action security_group_members [ 1016.552734] env[66519]: INFO networking_nsxv3.common.synchronization [req-81dca375-3a02-47a3-809d-b82df49c8267 req-9236b3a9-fc18-403e-83a2-ed26cbd3a1b3 service nova] Enqueued Resource ID: 27e2a0fd-bbdf-458c-9dd1-4c80cd7b320b with Priority: HIGHEST for action port [ 1016.553427] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 with Priority: HIGHEST for action security_group_rules [ 1016.554346] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 with Priority: HIGHEST for action security_group_members [ 1016.554538] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27e2a0fd-bbdf-458c-9dd1-4c80cd7b320b with Priority: HIGHEST for action port [ 1016.554869] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.555782] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.555865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.556148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.556304] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e5e7bc4-c260-4f47-9e3e-5384e5bb5347',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.558557] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.558557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.558557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.558557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.558557] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.558557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.558557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.559186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.559186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.559186] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e5e7bc4-c260-4f47-9e3e-5384e5bb5347',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.560030] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-27e2a0fd-bbdf-458c-9dd1-4c80cd7b320b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.562466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27e2a0fd-bbdf-458c-9dd1-4c80cd7b320b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.562501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27e2a0fd-bbdf-458c-9dd1-4c80cd7b320b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.562657] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27e2a0fd-bbdf-458c-9dd1-4c80cd7b320b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.562747] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27e2a0fd-bbdf-458c-9dd1-4c80cd7b320b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.040173] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.065044] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e5e7bc4-c260-4f47-9e3e-5384e5bb5347',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.066163] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.066310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.066702] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27e2a0fd-bbdf-458c-9dd1-4c80cd7b320b with status ACTIVE [ 1017.066871] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.067137] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.067137] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.067304] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.067362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.067639] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.067700] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.067735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.067894] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.067974] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.068183] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.068356] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.068356] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.068679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.068679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.068679] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27e2a0fd-bbdf-458c-9dd1-4c80cd7b320b is going to be updated. [ 1017.093585] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.093777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.093848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.094178] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.094399] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.094605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27e2a0fd-bbdf-458c-9dd1-4c80cd7b320b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.435768] env[66519]: INFO networking_nsxv3.common.synchronization [req-4a08b391-bfe7-4d0b-8210-8b40ecb845bb req-9b33e47a-ad38-487e-ab15-2fb6d9739ca0 tempest-FloatingIPsAssociationNegativeTestJSON-1773591421 tempest-FloatingIPsAssociationNegativeTestJSON-1773591421-project-member] Enqueued Resource ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f with Priority: HIGHEST for action security_group_members [ 1017.436333] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f with Priority: HIGHEST for action security_group_members [ 1017.436640] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e34dd9-4c15-4da5-b28c-ce12a509f41f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.436762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.436828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.437110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.437272] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.437395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.437456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.437602] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.437692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.437768] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00e34dd9-4c15-4da5-b28c-ce12a509f41f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.543891] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.543891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.543891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.544179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.544260] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.544365] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 1017.569549] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e5e7bc4-c260-4f47-9e3e-5384e5bb5347',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.574675] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.574833] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.574907] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.575143] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.575292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.587862] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 1017.777627] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-892 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.777892] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-892" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.778082] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-892" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.778489] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-892" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.778853] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.779151] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.779242] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.779500] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.779688] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.779947] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1017.780121] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1017.780267] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1017.780411] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1017.780578] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1017.780695] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1017.780933] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1017.804588] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1017.804588] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1017.804588] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1017.804588] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-892" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.804993] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-c850026b-3847-4127-9a60-3f2cecf28b17 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.805224] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-c850026b-3847-4127-9a60-3f2cecf28b17" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.805380] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-c850026b-3847-4127-9a60-3f2cecf28b17" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.805818] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-c850026b-3847-4127-9a60-3f2cecf28b17" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.806156] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c850026b-3847-4127-9a60-3f2cecf28b17',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.939952] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.940165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.940228] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.940412] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.940501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.940702] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.940796] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.940851] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.940995] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.941082] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.941165] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f already deleted. [ 1017.941239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.072764] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.073114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.073114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.073256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.073328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.073422] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 is going to be created. [ 1018.098228] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.098228] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.098228] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.098228] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.098228] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.108838] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 in Status: UNINITIALIZED for 2s [ 1018.310247] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.310479] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.310607] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.310906] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.311073] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.311230] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port c850026b-3847-4127-9a60-3f2cecf28b17 not found, creating... [ 1018.311503] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.311661] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.311776] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.311997] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.312148] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.312436] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.312589] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.312707] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.312917] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.313062] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.313202] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: c850026b-3847-4127-9a60-3f2cecf28b17 is going to be created. [ 1018.339498] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.339709] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.339815] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.340111] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.340335] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.340562] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-c850026b-3847-4127-9a60-3f2cecf28b17" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.133168] env[66519]: INFO networking_nsxv3.common.synchronization [req-4a08b391-bfe7-4d0b-8210-8b40ecb845bb req-7e770efa-e240-4a0a-9a13-fda7e7d27731 service nova] Enqueued Resource ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f with Priority: HIGHEST for action security_group_rules [ 1019.133555] env[66519]: INFO networking_nsxv3.common.synchronization [req-4a08b391-bfe7-4d0b-8210-8b40ecb845bb req-7e770efa-e240-4a0a-9a13-fda7e7d27731 service nova] Enqueued Resource ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f with Priority: HIGHEST for action security_group_members [ 1019.133555] env[66519]: INFO networking_nsxv3.common.synchronization [req-4a08b391-bfe7-4d0b-8210-8b40ecb845bb req-7e770efa-e240-4a0a-9a13-fda7e7d27731 service nova] Enqueued Resource ID: c850026b-3847-4127-9a60-3f2cecf28b17 with Priority: HIGHEST for action port [ 1019.133994] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f with Priority: HIGHEST for action security_group_rules [ 1019.134388] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f with Priority: HIGHEST for action security_group_members [ 1019.134505] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c850026b-3847-4127-9a60-3f2cecf28b17 with Priority: HIGHEST for action port [ 1019.135138] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00e34dd9-4c15-4da5-b28c-ce12a509f41f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.135138] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.135138] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.135283] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.135401] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00e34dd9-4c15-4da5-b28c-ce12a509f41f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.136345] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e34dd9-4c15-4da5-b28c-ce12a509f41f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.136505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.136806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.136806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.136941] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.137011] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.137052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.137296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.137296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.137452] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00e34dd9-4c15-4da5-b28c-ce12a509f41f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.138227] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-c850026b-3847-4127-9a60-3f2cecf28b17 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.138349] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c850026b-3847-4127-9a60-3f2cecf28b17" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.138409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c850026b-3847-4127-9a60-3f2cecf28b17" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.138530] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c850026b-3847-4127-9a60-3f2cecf28b17" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.138608] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c850026b-3847-4127-9a60-3f2cecf28b17',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.597588] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 1019.597821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.597988] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.598221] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.598410] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.598525] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.598584] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.598726] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.598804] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.598891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.598997] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.641474] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00e34dd9-4c15-4da5-b28c-ce12a509f41f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.643026] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e34dd9-4c15-4da5-b28c-ce12a509f41f taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.643326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.643459] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c850026b-3847-4127-9a60-3f2cecf28b17 with status ACTIVE [ 1019.643705] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.643838] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.643911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.644641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.644757] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.644960] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.645082] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.645145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.645391] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.645551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.645845] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.646068] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.646068] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.646290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.646437] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.646527] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c850026b-3847-4127-9a60-3f2cecf28b17 is going to be updated. [ 1019.669280] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.669520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.669520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.669690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.669854] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.670022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c850026b-3847-4127-9a60-3f2cecf28b17" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.100968] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.101202] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.101202] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.101449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.101618] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.101773] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.101773] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.101935] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.102142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.102142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.102294] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.102390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.102390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.102538] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.102676] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.102762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.102816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.102955] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.103042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.103122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.103212] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.121507] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 in Status: SUCCESS [ 1020.121788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.121951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.122248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.122539] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.122663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.122726] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.122939] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.123036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.123127] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.123221] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e5e7bc4-c260-4f47-9e3e-5384e5bb5347',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.148775] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00e34dd9-4c15-4da5-b28c-ce12a509f41f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.605668] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb1cadf6-d26e-4714-b83e-0fcbe235e2e5: rpc.has_security_group_logging(os_id): False [ 1020.626371] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e5e7bc4-c260-4f47-9e3e-5384e5bb5347',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.630790] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.630790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.630790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.630790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.630790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.631047] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.631104] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.631211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.631475] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.631613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.631944] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.632123] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.632238] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.632486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.632626] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.632967] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.633147] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.633252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.633512] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.633665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.633811] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 1020.652294] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.652294] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.652294] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.652294] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.652294] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.652690] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f is going to be created. [ 1020.684082] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.684082] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.684082] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.684082] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.684616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.696903] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f in Status: UNINITIALIZED for 2s [ 1020.719599] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.719733] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.719733] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.720080] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.720266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.737714] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 1021.137103] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347: rpc.has_security_group_logging(os_id): False [ 1021.161312] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.161312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.161312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.162165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.162165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.162165] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.162165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.162165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.162165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.162530] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.162530] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 is going to be created. [ 1021.253186] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.253489] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.253489] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.253743] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.253927] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.304694] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 in Status: IN_PROGRESS for 2s [ 1022.104574] env[66519]: INFO networking_nsxv3.common.synchronization [req-2d821807-1185-47ea-afad-2fec7b6a1eb1 req-ef406911-8a7b-408a-8d32-cd9b5ec29f42 tempest-ServerRescueNegativeTestJSON-912870119 tempest-ServerRescueNegativeTestJSON-912870119-project-member] Enqueued Resource ID: 00c72ce6-74fa-4138-bcac-05408508b67c with Priority: HIGHEST for action security_group_members [ 1022.105172] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00c72ce6-74fa-4138-bcac-05408508b67c with Priority: HIGHEST for action security_group_members [ 1022.105588] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00c72ce6-74fa-4138-bcac-05408508b67c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.105727] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.105794] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.106012] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.106183] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.109512] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.109587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.109783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.109878] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.109978] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00c72ce6-74fa-4138-bcac-05408508b67c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.612674] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.612674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.613178] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.613178] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.635520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.635911] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.636174] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.636174] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.636305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.636374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.636474] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00c72ce6-74fa-4138-bcac-05408508b67c is going to be updated. [ 1022.670348] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.670649] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.670649] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.670795] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.670860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.683478] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00c72ce6-74fa-4138-bcac-05408508b67c in Status: IN_PROGRESS for 2s [ 1022.708058] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f in Status: SUCCESS [ 1022.708272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.708331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.708588] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.708793] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.708912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.708978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.709163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.709275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.709323] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.709413] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00e34dd9-4c15-4da5-b28c-ce12a509f41f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.760123] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 1022.760355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.212366] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e34dd9-4c15-4da5-b28c-ce12a509f41f taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.212537] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.212640] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.213086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.213340] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.213472] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.213618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.213833] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.213945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.214079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.214273] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e34dd9-4c15-4da5-b28c-ce12a509f41f taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.214393] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.214476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.214650] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.214826] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.215018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.215124] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.215338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.215464] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.215625] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.215708] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00e34dd9-4c15-4da5-b28c-ce12a509f41f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.323483] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 in Status: SUCCESS [ 1023.323483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.719438] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00e34dd9-4c15-4da5-b28c-ce12a509f41f: rpc.has_security_group_logging(os_id): False [ 1023.740253] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.740422] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.740422] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.740718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.740718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.740961] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.741086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.741168] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.741634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.741634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.741634] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.741634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.741907] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.741907] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.741907] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.742159] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.742159] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.742326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.742400] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.742464] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.742549] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f is going to be created. [ 1023.802926] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.803079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.803168] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.803412] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.803643] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.814965] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f in Status: IN_PROGRESS for 2s [ 1023.941451] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.941726] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.941726] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.941926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.942348] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.444807] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.694975] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00c72ce6-74fa-4138-bcac-05408508b67c in Status: SUCCESS [ 1024.695187] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00c72ce6-74fa-4138-bcac-05408508b67c deletion is rescheduled due to dependency. [ 1024.695303] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00c72ce6-74fa-4138-bcac-05408508b67c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.946951] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.449719] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1025.449909] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1025.827540] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f in Status: SUCCESS [ 1025.827891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.380786] env[66519]: INFO networking_nsxv3.common.synchronization [req-950296e5-2060-4cf1-9750-5ad0cb4658b5 req-8f3e1368-2ff2-4ee0-87d6-1e6dc2d10401 tempest-ServersTestJSON-971253557 tempest-ServersTestJSON-971253557-project-member] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1026.382098] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1026.385402] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.385402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.385402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.385402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.385402] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.385402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.385402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.385402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.385402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.385402] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.445543] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.445751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.445821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.446158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.461711] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1026.462964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.464706] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1026.510637] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.510864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.510864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.511151] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.525649] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.525649] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1026.525927] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1026.525927] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1026.572138] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.573198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.573198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.573198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.575087] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.575466] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1026.702716] env[66519]: INFO networking_nsxv3.common.synchronization [req-01559b1d-366d-49ab-9ba8-3aa6d2f2c6b0 req-43e30341-e8f5-42ba-b397-020041149d2d tempest-DeleteServersTestJSON-1278201394 tempest-DeleteServersTestJSON-1278201394-project-member] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1026.704891] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1026.704891] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.704891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.705175] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.705769] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.705769] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.705997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.706157] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.707244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.707244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.707244] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.720748] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.722323] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.722323] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.722323] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.722323] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.722323] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1026.818059] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.818248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.818248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.818384] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.818763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.820994] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:42. [ 1026.820994] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'34191aa8-8997-42e0-88cc-151380dc439e', '2713653c-36b0-489e-8ec3-6cae0694eead', 'e7af6979-b772-40ee-bdb9-b29ca300beee', '00e34dd9-4c15-4da5-b28c-ce12a509f41f', 'c93d149b-db2a-420d-81f5-177c6bdd9505', '6cb7c090-e083-487a-aa5d-420200af9bce', '78ee5c7f-abf9-47ad-98da-200bfacc0aeb', '1e8b7135-b92c-4b10-aa25-eb568bfe0ab7', '85cd9d13-e10b-45af-9c04-2923bcfe37db', 'ce52e424-4971-4af0-bb7e-19455530de2e', 'cb1cadf6-d26e-4714-b83e-0fcbe235e2e5', '9b4e85b6-ed99-4ac0-9639-f46dc275381b', '00387676-9ba9-4227-8ddc-1da0bacf2f93', 'fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4', '2ff4300a-fb40-480e-bce1-da4cdaede807', '60c13785-2872-4af9-91d3-148ba8f8cc39', '76ce9371-2113-4da6-8d86-1fcee6902f41', 'a766da37-b2e2-4b4b-a76f-5622297330c4', 'ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0', 'f825e83f-7046-4bbd-969b-a037ace80c92', 'c204b4b3-a1d5-4736-9d79-b4de3adce0c8', 'bce1c878-084f-4aa4-935c-834b7a1e28f9', '820ceacd-99d3-4034-aaf8-315de338869a', 'facac47b-64fc-4659-9f54-1cb6066b4b88', '2b539ffb-57a2-420e-8eb3-8a80c9021bc6', 'bb3bbf89-6cbf-4b9e-b793-607035a2d9c3', '8806842e-05bb-42d4-891f-7827a3b60a33', '9619a08c-5035-47ce-91cf-089cdb9ae303', 'e0272502-d55a-4dab-9801-a7c27a17a4ef', 'c8a24d0e-87af-4465-ae43-ca9c589fc6b0', '6960f374-b898-4940-b626-d2d9b6819605', '8a189ee8-76c8-41eb-9042-b1c1fc45d147', '811de0c5-86ee-4ef7-afc3-0946a87f0b2e', '00c72ce6-74fa-4138-bcac-05408508b67c', 'ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9', 'c764bdd1-e51a-4d68-8351-c0fcec7cc0d1', 'fb0f115b-2ae8-4ea8-bf0a-99edddaaee58', '393aa0d3-c462-4737-b799-041054ed8323', 'fc90b596-5915-4a67-a6d8-a20bd8cf9e3c', '8e5e7bc4-c260-4f47-9e3e-5384e5bb5347', '376a7ea3-3e4d-4872-be2f-8bc029c25fac', 'a9ed5e58-fb42-4430-8674-e9d732009460'} {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1026.820994] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1026.856595] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.856824] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.856824] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.857109] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.857211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.857338] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1026.857418] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1026.857526] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1026.888398] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.975768] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.976013] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.976013] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.976273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.977424] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.981774] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1026.981968] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1026.982144] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1026.982241] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1026.982334] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/42 resources of Type:Security Group Rules [ 1026.982411] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGH for action security_group_rules [ 1026.982513] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGH for action security_group_rules [ 1026.982592] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGH for action security_group_rules [ 1026.982703] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f with Priority: HIGH for action security_group_rules [ 1026.982772] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGH for action security_group_rules [ 1026.982831] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGH for action security_group_rules [ 1026.982902] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGH for action security_group_rules [ 1026.984915] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGH for action security_group_rules [ 1026.984915] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGH for action security_group_rules [ 1026.984915] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGH for action security_group_rules [ 1026.984915] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGH for action security_group_rules [ 1026.984915] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGH for action security_group_rules [ 1026.984915] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 with Priority: HIGH for action security_group_rules [ 1026.984915] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGH for action security_group_rules [ 1026.984915] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 with Priority: HIGH for action security_group_rules [ 1026.984915] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 with Priority: HIGH for action security_group_rules [ 1026.984915] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 with Priority: HIGH for action security_group_rules [ 1026.984915] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGH for action security_group_rules [ 1026.984915] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 with Priority: HIGH for action security_group_rules [ 1026.984915] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGH for action security_group_rules [ 1026.984915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.055028] env[66519]: INFO networking_nsxv3.common.synchronization [req-cc1571a9-3f80-4c2f-9cae-27dce680900a req-ea5b2e25-399b-434d-b50d-8f2fdf50c7ba tempest-ImagesTestJSON-1420515381 tempest-ImagesTestJSON-1420515381-project-member] Enqueued Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 1027.055028] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGHEST for action security_group_members [ 1027.055028] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34191aa8-8997-42e0-88cc-151380dc439e with Priority: HIGH for action security_group_rules [ 1027.055028] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGH for action security_group_rules [ 1027.055028] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGH for action security_group_rules [ 1027.055550] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 with Priority: HIGH for action security_group_rules [ 1027.055706] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f825e83f-7046-4bbd-969b-a037ace80c92 with Priority: HIGH for action security_group_rules [ 1027.055823] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 with Priority: HIGH for action security_group_rules [ 1027.055969] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGH for action security_group_rules [ 1027.056567] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 with Priority: HIGH for action security_group_rules [ 1027.056698] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGH for action security_group_rules [ 1027.056825] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 with Priority: HIGH for action security_group_rules [ 1027.056973] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 with Priority: HIGH for action security_group_rules [ 1027.057120] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGH for action security_group_rules [ 1027.057227] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGH for action security_group_rules [ 1027.057325] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce52e424-4971-4af0-bb7e-19455530de2e with Priority: HIGH for action security_group_rules [ 1027.057447] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db with Priority: HIGH for action security_group_rules [ 1027.057563] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6cb7c090-e083-487a-aa5d-420200af9bce with Priority: HIGH for action security_group_rules [ 1027.057756] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGH for action security_group_rules [ 1027.057806] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c93d149b-db2a-420d-81f5-177c6bdd9505 with Priority: HIGH for action security_group_rules [ 1027.057939] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGH for action security_group_rules [ 1027.058079] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f with Priority: HIGH for action security_group_rules [ 1027.058681] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.058789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.058854] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.059429] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.059629] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.059747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.059841] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.060014] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.060108] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.060204] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.061292] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34191aa8-8997-42e0-88cc-151380dc439e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.061422] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.061490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.061693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.061789] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34191aa8-8997-42e0-88cc-151380dc439e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.063199] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.063326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.063410] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.063619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.063712] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.064625] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.064731] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.064796] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.064966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.065051] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.066789] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ff4300a-fb40-480e-bce1-da4cdaede807 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.066979] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.066979] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.067252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.067331] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ff4300a-fb40-480e-bce1-da4cdaede807',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.068275] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f825e83f-7046-4bbd-969b-a037ace80c92 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.068567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.068666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.068849] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.069159] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f825e83f-7046-4bbd-969b-a037ace80c92',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.069751] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.069863] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.069929] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.070228] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.070307] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.071485] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a766da37-b2e2-4b4b-a76f-5622297330c4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.071485] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.071485] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.071886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.071946] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.073118] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-76ce9371-2113-4da6-8d86-1fcee6902f41 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.073118] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.073118] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.073118] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.073347] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('76ce9371-2113-4da6-8d86-1fcee6902f41',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.075184] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.075184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.075184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.075184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.075450] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.076430] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60c13785-2872-4af9-91d3-148ba8f8cc39 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.076541] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.076606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.076891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.076986] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60c13785-2872-4af9-91d3-148ba8f8cc39',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.077828] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00387676-9ba9-4227-8ddc-1da0bacf2f93 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.077933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.078122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.078844] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.078844] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00387676-9ba9-4227-8ddc-1da0bacf2f93',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.079475] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.080610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.080610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.080610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.080610] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.080754] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.080867] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.080931] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.081126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.081212] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.082043] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ce52e424-4971-4af0-bb7e-19455530de2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.082291] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.082291] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.082409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.082478] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ce52e424-4971-4af0-bb7e-19455530de2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.083201] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85cd9d13-e10b-45af-9c04-2923bcfe37db taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.083310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.083376] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.083527] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.083601] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85cd9d13-e10b-45af-9c04-2923bcfe37db',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.084488] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6cb7c090-e083-487a-aa5d-420200af9bce taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.085014] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.085014] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.085014] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.085014] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6cb7c090-e083-487a-aa5d-420200af9bce',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.087834] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.087834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.087834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.087834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.087834] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e8b7135-b92c-4b10-aa25-eb568bfe0ab7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.088942] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c93d149b-db2a-420d-81f5-177c6bdd9505 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.089069] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.089580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.089580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.089580] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c93d149b-db2a-420d-81f5-177c6bdd9505',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.090604] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.090715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.090780] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.090942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.091025] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.091760] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00e34dd9-4c15-4da5-b28c-ce12a509f41f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.091869] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.091934] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.092136] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.092181] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00e34dd9-4c15-4da5-b28c-ce12a509f41f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.194023] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-42 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.194023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.194023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.194023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.194023] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.195256] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.195359] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.195593] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.195723] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.195933] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.196061] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.196531] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.196713] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.196894] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.196987] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.197713] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.209411] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.209559] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.210427] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.210427] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.234230] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.234382] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1027.234514] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.234688] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.235068] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-31d36ffc-cab9-46bf-81e4-37905c5fba2c taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.235273] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-31d36ffc-cab9-46bf-81e4-37905c5fba2c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.235602] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-31d36ffc-cab9-46bf-81e4-37905c5fba2c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.235672] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-31d36ffc-cab9-46bf-81e4-37905c5fba2c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.235801] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31d36ffc-cab9-46bf-81e4-37905c5fba2c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.252565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.252565] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.252565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.252565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.252565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.252565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.253415] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1027.287973] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.288242] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.288316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.288536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.288717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.301621] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1027.392845] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.594034] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.594244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.594318] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.594541] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.594788] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.594915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.594986] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.595317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.595462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.595577] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.595750] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.596805] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.596914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.596980] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.597178] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.597336] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.597459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.597527] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.597807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.597944] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.598252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.598433] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.600532] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.600642] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.600711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.600867] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.601824] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.601917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.602146] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b4e85b6-ed99-4ac0-9639-f46dc275381b taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.602246] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.602310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.602459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.602612] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.602705] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.602764] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.602900] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.602983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.603222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.603312] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.607320] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.607320] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.607320] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.607320] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.607628] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.607628] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.607628] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.607832] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.607922] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.608052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.608107] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.611442] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a766da37-b2e2-4b4b-a76f-5622297330c4 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.611442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.611442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.611442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.611442] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.611442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.611442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.611812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.611812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.611812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.611812] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.616492] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c13785-2872-4af9-91d3-148ba8f8cc39 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.616492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.616492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.616685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.618766] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.618766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.618766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.618766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.618766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.618766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.618766] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60c13785-2872-4af9-91d3-148ba8f8cc39',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.618766] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.618766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.618766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.618766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.619240] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.619240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.619240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.619240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.619240] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.619416] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.619416] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.624764] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.625615] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.629199] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.629199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.629199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.629199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.629199] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.629434] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.629434] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.629434] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.629538] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.629574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.630093] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.630093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.630093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.630093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.630359] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.630359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.630359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.630473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.630473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.630543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.632090] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.633099] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e34dd9-4c15-4da5-b28c-ce12a509f41f taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.633208] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.633277] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.633472] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.633713] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.633820] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.633878] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.634035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.634113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.634195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.634279] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00e34dd9-4c15-4da5-b28c-ce12a509f41f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.679964] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.680172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.680965] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.681234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.682049] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.682049] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.682684] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.682792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.683471] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.683572] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.684225] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.684330] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.685235] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.685235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.686021] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.686112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.686794] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.686899] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.687809] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.688010] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.688175] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.688175] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.688542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.688542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.688652] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be updated. [ 1027.690835] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.690835] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.691313] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.691455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.702625] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.702747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.716550] env[66519]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1027.717245] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.717663] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ce52e424-4971-4af0-bb7e-19455530de2e is going to be deleted. [ 1027.720508] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.720788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.727050] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.727050] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.727050] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.727517] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.728107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.740583] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: IN_PROGRESS for 2s [ 1027.741178] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.741416] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.741548] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.741866] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.742018] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.742183] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 31d36ffc-cab9-46bf-81e4-37905c5fba2c not found, creating... [ 1027.742899] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.742899] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.742899] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.743105] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.743215] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.743536] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.743707] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.743827] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.744078] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.744260] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.744411] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 31d36ffc-cab9-46bf-81e4-37905c5fba2c is going to be created. [ 1027.748452] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.748602] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85cd9d13-e10b-45af-9c04-2923bcfe37db is going to be deleted. [ 1027.749782] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.750118] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.770205] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.770205] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.770478] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.771855] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.772373] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.773166] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-31d36ffc-cab9-46bf-81e4-37905c5fba2c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.775166] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.775382] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f825e83f-7046-4bbd-969b-a037ace80c92 is going to be deleted. [ 1027.776626] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.777486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.816457] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.816568] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.818446] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.818559] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.822457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.823899] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6cb7c090-e083-487a-aa5d-420200af9bce is going to be deleted. [ 1027.823899] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.824285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.876496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.876756] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 76ce9371-2113-4da6-8d86-1fcee6902f41 is going to be deleted. [ 1027.878183] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.878800] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.895976] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.896232] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.896328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.896606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.896687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.896798] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 1028.002176] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.002176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.008156] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.008156] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 is going to be deleted. [ 1028.009506] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.009506] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.012077] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.012202] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.035983] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.035983] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.036298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.036361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.036561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.055657] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 1028.074855] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.075022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.085947] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.086104] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00387676-9ba9-4227-8ddc-1da0bacf2f93 is going to be deleted. [ 1028.087120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.087372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.100386] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.123010] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.123982] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60c13785-2872-4af9-91d3-148ba8f8cc39',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.138499] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b4e85b6-ed99-4ac0-9639-f46dc275381b: rpc.has_security_group_logging(os_id): False [ 1028.140368] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4: rpc.has_security_group_logging(os_id): False [ 1028.142702] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78ee5c7f-abf9-47ad-98da-200bfacc0aeb: rpc.has_security_group_logging(os_id): False [ 1028.143789] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e34dd9-4c15-4da5-b28c-ce12a509f41f taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.143979] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.143979] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.144195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.144296] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.144396] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.144458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.144609] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.144700] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.144786] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.144946] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e34dd9-4c15-4da5-b28c-ce12a509f41f taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.145061] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.145123] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.145267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.145409] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.145567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.145660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.145805] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.145885] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.145967] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.146091] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00e34dd9-4c15-4da5-b28c-ce12a509f41f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.147106] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.147789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.147789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.147789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.147789] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.147789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.147789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.148030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.148030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.148110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.148208] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.148322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.148381] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.148520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.148681] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.148814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.148847] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.148987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.149093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.149176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.149264] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.175365] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.175542] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34191aa8-8997-42e0-88cc-151380dc439e is going to be deleted. [ 1028.176600] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.176908] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.199301] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.199587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.211465] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.211673] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.214254] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.214723] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ff4300a-fb40-480e-bce1-da4cdaede807 is going to be deleted. [ 1028.216193] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.216523] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.216697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.216864] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 is going to be deleted. [ 1028.219445] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.219613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.219703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.220029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.271063] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.271063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.271718] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.271826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.279859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.280241] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.280364] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.280424] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.280720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.280720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.280826] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b is going to be updated. [ 1028.282060] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.282255] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.282446] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.282502] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85cd9d13-e10b-45af-9c04-2923bcfe37db" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.282625] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.282788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.282862] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.283839] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ce52e424-4971-4af0-bb7e-19455530de2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.283839] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.284090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.284133] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.284269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f825e83f-7046-4bbd-969b-a037ace80c92" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.284391] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.284544] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.284623] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.284744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6cb7c090-e083-487a-aa5d-420200af9bce" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.285812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.286024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.286117] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.286239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-76ce9371-2113-4da6-8d86-1fcee6902f41" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.286409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.286555] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.351170] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.351362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.363727] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.363936] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.373347] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.373773] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.410711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.411081] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.411214] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.411285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.411511] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.411596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.411821] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.411930] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.411992] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.412610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.412610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.412610] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.412610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.412610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.412918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.412918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.412918] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 is going to be updated. [ 1028.415069] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.415263] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.475023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.475023] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0 is going to be deleted. [ 1028.475023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.475023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.475023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.475023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.475023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.475023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.534687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.534872] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.534997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.535097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.535350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.535453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.535572] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb is going to be updated. [ 1028.537541] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.537642] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.537742] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.537912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.538113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.538299] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.538379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.538526] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ff4300a-fb40-480e-bce1-da4cdaede807" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.539762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.540640] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.540640] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.540640] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34191aa8-8997-42e0-88cc-151380dc439e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.540640] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.540918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.541039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.541137] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00387676-9ba9-4227-8ddc-1da0bacf2f93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.542800] env[66519]: INFO networking_nsxv3.common.synchronization [req-01559b1d-366d-49ab-9ba8-3aa6d2f2c6b0 req-687022b8-2e89-48e2-9ee7-2c96c75f0b01 service nova] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_rules [ 1028.543139] env[66519]: INFO networking_nsxv3.common.synchronization [req-01559b1d-366d-49ab-9ba8-3aa6d2f2c6b0 req-687022b8-2e89-48e2-9ee7-2c96c75f0b01 service nova] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1028.543247] env[66519]: INFO networking_nsxv3.common.synchronization [req-01559b1d-366d-49ab-9ba8-3aa6d2f2c6b0 req-687022b8-2e89-48e2-9ee7-2c96c75f0b01 service nova] Enqueued Resource ID: 31d36ffc-cab9-46bf-81e4-37905c5fba2c with Priority: HIGHEST for action port [ 1028.543875] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_rules [ 1028.544040] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1028.544142] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31d36ffc-cab9-46bf-81e4-37905c5fba2c with Priority: HIGHEST for action port [ 1028.544458] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.544581] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.544646] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.544869] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.545021] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.545955] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.546136] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.546452] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-31d36ffc-cab9-46bf-81e4-37905c5fba2c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.546571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31d36ffc-cab9-46bf-81e4-37905c5fba2c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.546630] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31d36ffc-cab9-46bf-81e4-37905c5fba2c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.546905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31d36ffc-cab9-46bf-81e4-37905c5fba2c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.546988] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31d36ffc-cab9-46bf-81e4-37905c5fba2c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.603696] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7af6979-b772-40ee-bdb9-b29ca300beee: rpc.has_security_group_logging(os_id): False [ 1028.606713] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.607188] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.607333] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.607750] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.609065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.625847] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a766da37-b2e2-4b4b-a76f-5622297330c4: rpc.has_security_group_logging(os_id): False [ 1028.628493] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60c13785-2872-4af9-91d3-148ba8f8cc39: rpc.has_security_group_logging(os_id): False [ 1028.653125] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.653125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.653125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.653125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.653125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.654683] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00e34dd9-4c15-4da5-b28c-ce12a509f41f: rpc.has_security_group_logging(os_id): False [ 1028.656550] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2713653c-36b0-489e-8ec3-6cae0694eead: rpc.has_security_group_logging(os_id): False [ 1028.659987] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.660195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.660283] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.660564] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.666183] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.666311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.701506] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.701679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.702683] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.703036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.703848] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.703933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.710631] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.710816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.715648] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b in Status: IN_PROGRESS for 2s [ 1028.716508] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: IN_PROGRESS for 2s [ 1028.720030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.720383] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.720513] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.720568] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.721871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.722030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.722204] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee is going to be updated. [ 1028.723961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.724200] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.724293] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.724411] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee4c5fc5-530f-46ca-96e5-6fc73a0d7de0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.724565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.724813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.747984] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.748209] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.785561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.786084] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.786339] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.786406] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.786696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.786804] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.786925] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 is going to be updated. [ 1028.788430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.788823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.846932] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.848034] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.848034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.848034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.848322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.848322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.849034] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.849034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.849034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.849034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.849034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.849034] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.849034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.849409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.849409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.849409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.849409] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2713653c-36b0-489e-8ec3-6cae0694eead is going to be updated. [ 1028.850754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.850930] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.853152] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.853152] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.918405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.918887] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.919074] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.919074] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.919272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.919360] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.919463] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a766da37-b2e2-4b4b-a76f-5622297330c4 is going to be updated. [ 1028.920588] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.920823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.958498] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.958722] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.967588] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.967959] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.968105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.968174] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.968394] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.968480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.968698] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.968824] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.968894] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.969113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.969190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.969378] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.969465] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.969508] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.969648] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.969746] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.969842] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f is going to be updated. [ 1028.973167] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.973386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.973550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.974552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.974720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.974893] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.975834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.976011] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.976140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.014251] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.014431] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.014526] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.014799] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.014971] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.028930] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 in Status: IN_PROGRESS for 2s [ 1029.030275] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: IN_PROGRESS for 2s [ 1029.032583] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: IN_PROGRESS for 2s [ 1029.050280] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.050460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.051732] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31d36ffc-cab9-46bf-81e4-37905c5fba2c with status ACTIVE [ 1029.052809] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.052809] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.052809] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.052809] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.052809] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.053269] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.053269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.053269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.053431] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.053431] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.053611] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.053718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.053831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.053920] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.053981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.054078] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31d36ffc-cab9-46bf-81e4-37905c5fba2c is going to be updated. [ 1029.084299] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2713653c-36b0-489e-8ec3-6cae0694eead in Status: IN_PROGRESS for 2s [ 1029.112335] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.112555] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.112555] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.112778] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.113083] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.113279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31d36ffc-cab9-46bf-81e4-37905c5fba2c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.128557] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.128781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.128954] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.129298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.129542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.145332] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a766da37-b2e2-4b4b-a76f-5622297330c4 in Status: IN_PROGRESS for 2s [ 1029.185922] env[66519]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1029.186596] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.186758] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.186837] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.187178] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.187354] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.225041] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f in Status: IN_PROGRESS for 2s [ 1029.318109] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1029.318306] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e deletion is rescheduled due to dependency. [ 1029.318441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.318596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.318829] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.319038] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.319169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.319231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.319390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.319474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.319564] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.752057] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c93d149b-db2a-420d-81f5-177c6bdd9505 in Status: SUCCESS [ 1029.752057] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c93d149b-db2a-420d-81f5-177c6bdd9505 deletion is rescheduled due to dependency. [ 1029.752057] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c93d149b-db2a-420d-81f5-177c6bdd9505" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.825477] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.069023] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 1030.069295] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.069548] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.069848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.070141] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.070303] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.070370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.070567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.070655] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.070783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.070886] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.220674] env[66519]: INFO networking_nsxv3.common.synchronization [req-79ba58a5-e3da-467b-95ae-562d4387ab40 req-f4ea530f-9e66-415b-86f8-2de9c3da4cb7 tempest-ServersAdminTestJSON-863383517 tempest-ServersAdminTestJSON-863383517-project-member] Enqueued Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 1030.221349] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 1030.221968] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.222125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.222227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.222514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.222690] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.222812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.222880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.223078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.223177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.223272] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.327199] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.574719] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.574866] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.574955] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.575226] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.575412] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.575566] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.575702] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.575931] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.576061] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.576193] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.576374] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.576527] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.576617] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.576789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.576961] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.577097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.577180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.577351] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.577445] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.577573] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.577723] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.600039] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-314 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.600263] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.600362] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.600725] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.601116] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.601338] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.601521] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.601774] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.602183] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.602478] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.602674] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1030.602844] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1030.603018] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1030.603203] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1030.603413] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1030.603578] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1030.624220] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1030.624411] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1030.624529] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1030.624709] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-314" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.625055] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-a7524343-a18a-48f6-8f1d-8848ac2c5113 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.625189] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-a7524343-a18a-48f6-8f1d-8848ac2c5113" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.625307] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-a7524343-a18a-48f6-8f1d-8848ac2c5113" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.625690] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-a7524343-a18a-48f6-8f1d-8848ac2c5113" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.625801] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7524343-a18a-48f6-8f1d-8848ac2c5113',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.727317] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.734981] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b in Status: SUCCESS [ 1030.734981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.734981] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: SUCCESS [ 1030.734981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.831989] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.831989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.831989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.832444] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.832444] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.832444] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1030.868325] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.868500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.868569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.868873] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.869097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.885470] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1031.044389] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: SUCCESS [ 1031.044654] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.045439] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: SUCCESS [ 1031.045702] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.046334] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 in Status: SUCCESS [ 1031.046559] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.080180] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb1cadf6-d26e-4714-b83e-0fcbe235e2e5: rpc.has_security_group_logging(os_id): False [ 1031.098082] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2713653c-36b0-489e-8ec3-6cae0694eead in Status: SUCCESS [ 1031.098304] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.099235] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.099374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.099425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.099629] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.119748] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.120144] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.120338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.120422] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.120646] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.120738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.120981] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.121116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.121185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.121360] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.121440] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.121653] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.121774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.121839] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.121984] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.122069] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.122155] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 1031.128518] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.128713] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.128841] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.129502] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.129502] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.129502] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port a7524343-a18a-48f6-8f1d-8848ac2c5113 not found, creating... [ 1031.129710] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.129800] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.129910] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.130157] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.130296] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.130609] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.130767] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.130881] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.131109] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.131248] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.131381] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: a7524343-a18a-48f6-8f1d-8848ac2c5113 is going to be created. [ 1031.152960] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.153300] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.153529] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.153944] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.154369] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.154761] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-a7524343-a18a-48f6-8f1d-8848ac2c5113" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.158444] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a766da37-b2e2-4b4b-a76f-5622297330c4 in Status: SUCCESS [ 1031.158776] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.193256] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.193514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.193514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.193685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.193838] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.213664] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 1031.222109] env[66519]: INFO networking_nsxv3.common.synchronization [req-0691bdae-c818-4fd3-ade3-5fd91a63e09e req-90545432-43be-40f8-be51-f84ff4fe0c9f tempest-ServersTestFqdnHostnames-927688424 tempest-ServersTestFqdnHostnames-927688424-project-member] Enqueued Resource ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 with Priority: HIGHEST for action security_group_members [ 1031.222776] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 with Priority: HIGHEST for action security_group_members [ 1031.223223] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-60c13785-2872-4af9-91d3-148ba8f8cc39 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.223346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.223439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.223615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.223765] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.223861] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.223919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.224078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.224166] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.224259] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60c13785-2872-4af9-91d3-148ba8f8cc39',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.230815] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.242259] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f in Status: SUCCESS [ 1031.242491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.731120] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.731120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.731120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.731120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.731120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.731120] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.731120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.731120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.731120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.731120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.731120] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 is going to be updated. [ 1031.734220] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.736870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.736870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.736870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.736870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.736870] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 is going to be updated. [ 1031.767559] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.768286] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.768286] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.768643] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.768903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.771639] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.771639] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.771639] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.771976] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.773602] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.784097] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: IN_PROGRESS for 2s [ 1031.784097] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 in Status: IN_PROGRESS for 2s [ 1031.944245] env[66519]: INFO networking_nsxv3.common.synchronization [req-79ba58a5-e3da-467b-95ae-562d4387ab40 req-7f678fa3-f16d-4f3a-a918-46d484d6b465 service nova] Enqueued Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_rules [ 1031.944245] env[66519]: INFO networking_nsxv3.common.synchronization [req-79ba58a5-e3da-467b-95ae-562d4387ab40 req-7f678fa3-f16d-4f3a-a918-46d484d6b465 service nova] Enqueued Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 1031.944245] env[66519]: INFO networking_nsxv3.common.synchronization [req-79ba58a5-e3da-467b-95ae-562d4387ab40 req-7f678fa3-f16d-4f3a-a918-46d484d6b465 service nova] Enqueued Resource ID: a7524343-a18a-48f6-8f1d-8848ac2c5113 with Priority: HIGHEST for action port [ 1031.944245] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_rules [ 1031.944245] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 1031.947037] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7524343-a18a-48f6-8f1d-8848ac2c5113 with Priority: HIGHEST for action port [ 1031.947037] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.947037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.947037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.947037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.947037] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.947918] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.948095] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.954021] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7524343-a18a-48f6-8f1d-8848ac2c5113 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.954021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7524343-a18a-48f6-8f1d-8848ac2c5113" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.954021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7524343-a18a-48f6-8f1d-8848ac2c5113" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.954021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7524343-a18a-48f6-8f1d-8848ac2c5113" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.954021] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7524343-a18a-48f6-8f1d-8848ac2c5113',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.456151] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7524343-a18a-48f6-8f1d-8848ac2c5113 with status ACTIVE [ 1032.456417] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.457331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.457331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.457331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.457331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.457331] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.458484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.458484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.458484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.458484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.458484] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.458484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.458686] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.459164] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.459164] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.459164] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7524343-a18a-48f6-8f1d-8848ac2c5113 is going to be updated. [ 1032.461081] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.461081] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.490242] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.490407] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.490460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.490657] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.490792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.490954] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7524343-a18a-48f6-8f1d-8848ac2c5113" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.898053] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1032.898280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.898840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.899064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.899252] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.899363] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.899419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.899581] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.899650] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.899740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.899839] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.229688] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 1033.230182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.404429] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.404750] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.404842] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.405113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.405298] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.405405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.405468] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.405749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.405858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.405961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.406154] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.406253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.406312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.406460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.406622] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.406733] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.406814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.406980] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.407080] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.407192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.407297] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.796995] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 in Status: SUCCESS [ 1033.796995] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 deletion is rescheduled due to dependency. [ 1033.796995] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.797282] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: SUCCESS [ 1033.797355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.797671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.797794] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.798548] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.798548] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.798548] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.798548] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.798548] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.798885] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.911406] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 811de0c5-86ee-4ef7-afc3-0946a87f0b2e: rpc.has_security_group_logging(os_id): False [ 1033.931798] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.931798] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.931798] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.932220] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.932501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.932918] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.934027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.934027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.934027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.934027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.934027] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.938089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.938089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.938089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.938089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.938089] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.938089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.938089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.938089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.938089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.938089] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1034.005497] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.005735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.005882] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.006055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.006220] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.020665] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1034.300543] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.802484] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.305559] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.306093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.306093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.306239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.306376] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.306491] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 is going to be updated. [ 1035.348803] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.349064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.349064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.349346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.349529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.363183] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: IN_PROGRESS for 2s [ 1036.033331] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1036.033524] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.616677] env[66519]: INFO networking_nsxv3.common.synchronization [req-7ee1c739-4795-4d1f-a995-957cbd4d7a56 req-e9cab29a-fa6c-4c96-9a4e-f61c0f66304b tempest-ServersTestJSON-971253557 tempest-ServersTestJSON-971253557-project-member] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1036.617154] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1036.617519] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.617645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.617714] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.618012] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.618243] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.618827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.618827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.618827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.618827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.618827] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.122601] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.373557] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: SUCCESS [ 1037.373810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.374150] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.374332] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.374527] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.374642] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.374704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.374855] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.374931] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.375037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.375128] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.624523] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.878236] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.878437] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.878483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.878682] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.878885] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.879039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.879109] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.879271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.879359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.879445] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.879591] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.879685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.879746] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.879903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.880053] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.880142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.880203] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.880342] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.880417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.880495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.880584] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.127176] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.127348] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.127426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.127658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.127795] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.127900] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 1038.160642] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.160642] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.160642] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.160642] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.160642] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.171179] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 1038.385312] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4: rpc.has_security_group_logging(os_id): False [ 1038.403908] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.408024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.408024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.408024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.408024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.408024] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.408024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.408024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.408024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.408024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.408024] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.408024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.408024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.408024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.408024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.408735] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.408735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.408735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.408735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.408735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.408735] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 is going to be updated. [ 1038.496090] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.496090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.496090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.496090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.496090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.512062] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: IN_PROGRESS for 2s [ 1038.878026] env[66519]: INFO networking_nsxv3.common.synchronization [req-0f0ab02b-4ae0-4dee-a309-bec9058fddfa req-4c036ee7-d0d3-4806-a737-93a5c53507d4 tempest-FloatingIPsAssociationNegativeTestJSON-1773591421 tempest-FloatingIPsAssociationNegativeTestJSON-1773591421-project-member] Enqueued Resource ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f with Priority: HIGHEST for action security_group_members [ 1038.878026] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f with Priority: HIGHEST for action security_group_members [ 1038.878026] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e34dd9-4c15-4da5-b28c-ce12a509f41f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.878026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.878026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.878026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.878026] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.878828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.879103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.879735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.879950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.881023] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00e34dd9-4c15-4da5-b28c-ce12a509f41f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.384091] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.385368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.385368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.385368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.385368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.385368] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.385368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.385368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.385368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.385368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.385787] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f is going to be updated. [ 1039.420409] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.420409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.420409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.420674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.420674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.430415] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f in Status: IN_PROGRESS for 2s [ 1039.996877] env[66519]: INFO networking_nsxv3.common.synchronization [req-33e3bb22-e049-41c1-9b76-1f6d0fb419e7 req-410c31b9-0aed-4d1e-bd09-0d40b08abf11 tempest-ServerRescueNegativeTestJSON-912870119 tempest-ServerRescueNegativeTestJSON-912870119-project-member] Enqueued Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGHEST for action security_group_members [ 1039.997534] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGHEST for action security_group_members [ 1039.998703] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.998767] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.998810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.999042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.999187] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.999290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.999351] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.999799] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.999799] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.999799] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.140303] env[66519]: INFO networking_nsxv3.common.synchronization [req-77e41018-37ab-481f-9ceb-56484b0ece1b req-e1c73b8b-85b5-43bb-a495-0cbbdd745d9c tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1040.140889] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1040.141336] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.141497] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.141585] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.141834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.142106] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.142282] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.142415] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.142620] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.142740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.143243] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.183979] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 1040.183979] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.504565] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.505933] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.506140] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.506264] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.506515] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.506761] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.506915] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.507070] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.507242] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.507382] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.507580] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.507688] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1040.507797] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1040.507938] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1040.508062] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1040.508164] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1040.508286] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1040.531042] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1040.531276] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1040.531398] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1040.531541] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.532630] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-c7360ee1-db31-4a0c-b6db-06c2e3125027 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.532842] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-c7360ee1-db31-4a0c-b6db-06c2e3125027" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.532969] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-c7360ee1-db31-4a0c-b6db-06c2e3125027" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.533315] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-c7360ee1-db31-4a0c-b6db-06c2e3125027" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.533781] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7360ee1-db31-4a0c-b6db-06c2e3125027',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.538973] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: SUCCESS [ 1040.539143] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.650097] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.651033] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.651033] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.651033] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.651033] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.651264] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.651264] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.651264] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.651388] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.651496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.651533] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be deleted. [ 1040.684095] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.684095] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.684578] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.684578] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.684682] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.685123] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.011177] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.041269] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.041269] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.041269] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.041493] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.041493] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.041646] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port c7360ee1-db31-4a0c-b6db-06c2e3125027 not found, creating... [ 1041.041911] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.042099] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.042215] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.042648] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.042648] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.043604] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.043604] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.043604] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.043604] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.043604] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.043604] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: c7360ee1-db31-4a0c-b6db-06c2e3125027 is going to be created. [ 1041.063663] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.064170] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.064170] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.064404] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.064570] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.064797] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-c7360ee1-db31-4a0c-b6db-06c2e3125027" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.445514] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f in Status: SUCCESS [ 1041.445746] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f deletion is rescheduled due to dependency. [ 1041.445903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.514260] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.514436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.514555] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.514865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.515012] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.515012] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2713653c-36b0-489e-8ec3-6cae0694eead is going to be updated. [ 1041.573069] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.573255] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.573301] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.573485] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.573633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.594160] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2713653c-36b0-489e-8ec3-6cae0694eead in Status: IN_PROGRESS for 2s [ 1041.801590] env[66519]: INFO networking_nsxv3.common.synchronization [req-77e41018-37ab-481f-9ceb-56484b0ece1b req-39f0866e-7eeb-4015-8872-b45eab18bdd6 service nova] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_rules [ 1041.802559] env[66519]: INFO networking_nsxv3.common.synchronization [req-77e41018-37ab-481f-9ceb-56484b0ece1b req-39f0866e-7eeb-4015-8872-b45eab18bdd6 service nova] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1041.802757] env[66519]: INFO networking_nsxv3.common.synchronization [req-77e41018-37ab-481f-9ceb-56484b0ece1b req-39f0866e-7eeb-4015-8872-b45eab18bdd6 service nova] Enqueued Resource ID: c7360ee1-db31-4a0c-b6db-06c2e3125027 with Priority: HIGHEST for action port [ 1041.804210] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_rules [ 1041.804605] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1041.804605] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7360ee1-db31-4a0c-b6db-06c2e3125027 with Priority: HIGHEST for action port [ 1041.804867] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.805019] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.805315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.805315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.805423] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.807366] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.807533] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.807590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.807757] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.808030] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.808159] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.808218] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.808519] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.808519] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.808629] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.810226] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7360ee1-db31-4a0c-b6db-06c2e3125027 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.811719] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7360ee1-db31-4a0c-b6db-06c2e3125027" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.811817] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7360ee1-db31-4a0c-b6db-06c2e3125027" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.812194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7360ee1-db31-4a0c-b6db-06c2e3125027" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.812194] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7360ee1-db31-4a0c-b6db-06c2e3125027',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.316034] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.316034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.316034] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.316583] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7360ee1-db31-4a0c-b6db-06c2e3125027 with status ACTIVE [ 1042.316872] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.317171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.318065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.318065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.318065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.319115] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.319115] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.319115] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.319646] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.319646] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.320116] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.320116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.320282] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.320553] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.320686] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.321035] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7360ee1-db31-4a0c-b6db-06c2e3125027 is going to be updated. [ 1042.352783] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.353027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.353027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.353299] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.353447] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.353615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7360ee1-db31-4a0c-b6db-06c2e3125027" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.824363] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.090016] env[66519]: INFO networking_nsxv3.common.synchronization [None req-2cc68e8c-cc2e-4177-b1bd-568fd079113d None None] Enqueued Resource ID: 430b9e2f-a0c4-4e8f-8a22-7d7df1c4b628 with Priority: HIGHEST for action port [ 1043.090311] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 430b9e2f-a0c4-4e8f-8a22-7d7df1c4b628 with Priority: HIGHEST for action port [ 1043.091482] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-430b9e2f-a0c4-4e8f-8a22-7d7df1c4b628 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.091711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-430b9e2f-a0c4-4e8f-8a22-7d7df1c4b628" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.091815] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-430b9e2f-a0c4-4e8f-8a22-7d7df1c4b628" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.092770] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-430b9e2f-a0c4-4e8f-8a22-7d7df1c4b628" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.092857] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('430b9e2f-a0c4-4e8f-8a22-7d7df1c4b628',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.237051] env[66519]: INFO networking_nsxv3.common.synchronization [None req-7d4a985f-3b89-4819-ae3a-23260e7da5fd None None] Enqueued Resource ID: 591235a9-4a3b-4ab9-ae5b-4cdc3cfb83b6 with Priority: HIGHEST for action port [ 1043.237051] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 591235a9-4a3b-4ab9-ae5b-4cdc3cfb83b6 with Priority: HIGHEST for action port [ 1043.237051] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-591235a9-4a3b-4ab9-ae5b-4cdc3cfb83b6 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.237051] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-591235a9-4a3b-4ab9-ae5b-4cdc3cfb83b6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.237051] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-591235a9-4a3b-4ab9-ae5b-4cdc3cfb83b6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.237745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-591235a9-4a3b-4ab9-ae5b-4cdc3cfb83b6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.238238] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('591235a9-4a3b-4ab9-ae5b-4cdc3cfb83b6',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.327745] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.327745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.327745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.327745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.327745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.327745] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be created. [ 1043.355498] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.355498] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.355498] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.355498] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.355498] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.366349] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: UNINITIALIZED for 2s [ 1043.596298] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 430b9e2f-a0c4-4e8f-8a22-7d7df1c4b628 [ 1043.596550] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.596679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.596881] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.597201] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.597201] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.597325] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:430b9e2f-a0c4-4e8f-8a22-7d7df1c4b628 already deleted. [ 1043.597424] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-430b9e2f-a0c4-4e8f-8a22-7d7df1c4b628" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.608548] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2713653c-36b0-489e-8ec3-6cae0694eead in Status: SUCCESS [ 1043.608548] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.742302] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 591235a9-4a3b-4ab9-ae5b-4cdc3cfb83b6 [ 1043.742482] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.743280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.743280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.743280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.743280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.743280] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:591235a9-4a3b-4ab9-ae5b-4cdc3cfb83b6 already deleted. [ 1043.743280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-591235a9-4a3b-4ab9-ae5b-4cdc3cfb83b6" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.328350] env[66519]: INFO networking_nsxv3.common.synchronization [None req-9387937e-66ef-4eb8-956a-509c3a529ef3 None None] Enqueued Resource ID: ca49a113-207a-4a52-8707-0e6d4be55d06 with Priority: HIGHEST for action port [ 1045.330370] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca49a113-207a-4a52-8707-0e6d4be55d06 with Priority: HIGHEST for action port [ 1045.330370] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca49a113-207a-4a52-8707-0e6d4be55d06 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.330370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca49a113-207a-4a52-8707-0e6d4be55d06" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.330370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca49a113-207a-4a52-8707-0e6d4be55d06" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.330370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca49a113-207a-4a52-8707-0e6d4be55d06" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.330370] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca49a113-207a-4a52-8707-0e6d4be55d06',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.378291] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: SUCCESS [ 1045.379933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.380177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.380386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.380588] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.380709] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.380766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.380938] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.381033] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.381124] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.381335] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.478385] env[66519]: INFO networking_nsxv3.common.synchronization [None req-c51dd0ac-77df-45e6-8e85-43fba434e190 None None] Enqueued Resource ID: 2a9dbd01-d3d9-4eee-ad49-5d5bd504a0fd with Priority: HIGHEST for action port [ 1045.478385] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a9dbd01-d3d9-4eee-ad49-5d5bd504a0fd with Priority: HIGHEST for action port [ 1045.478385] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a9dbd01-d3d9-4eee-ad49-5d5bd504a0fd taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.478385] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a9dbd01-d3d9-4eee-ad49-5d5bd504a0fd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.478385] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a9dbd01-d3d9-4eee-ad49-5d5bd504a0fd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.478751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a9dbd01-d3d9-4eee-ad49-5d5bd504a0fd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.478751] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a9dbd01-d3d9-4eee-ad49-5d5bd504a0fd',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.832804] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca49a113-207a-4a52-8707-0e6d4be55d06 [ 1045.833132] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.833281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.833432] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.833675] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.833747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.833848] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca49a113-207a-4a52-8707-0e6d4be55d06 already deleted. [ 1045.833903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca49a113-207a-4a52-8707-0e6d4be55d06" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.886496] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.886718] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.886968] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.887223] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.887403] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.887509] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.887598] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.887764] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.887870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.887990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.888158] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.888252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.888313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.888457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.888597] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.888702] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.888740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.888886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.888989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.889098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.889189] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.981341] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a9dbd01-d3d9-4eee-ad49-5d5bd504a0fd [ 1045.981576] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.981706] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.981768] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.982057] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.982153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.982303] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a9dbd01-d3d9-4eee-ad49-5d5bd504a0fd already deleted. [ 1045.982366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a9dbd01-d3d9-4eee-ad49-5d5bd504a0fd" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.393993] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a5c9fd2-e0f8-469b-9019-610142582634: rpc.has_security_group_logging(os_id): False [ 1046.416399] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.416766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.416766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.416987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.417141] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.417381] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.417533] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.417621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.418320] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.418320] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.418320] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.418320] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.418536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.418536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.418597] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.419652] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.419652] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.419652] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.419652] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.419652] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.419652] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be created. [ 1046.483252] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.483429] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.483498] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.483792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.484024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.497134] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: IN_PROGRESS for 2s [ 1047.425858] env[66519]: INFO networking_nsxv3.common.synchronization [None req-d635332b-b9a0-497d-8fa6-964c0a0bec8c tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1047.426329] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1047.426634] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.426752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.426819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.427034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.427190] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.427288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.427348] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.427497] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.427583] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.427673] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.930062] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.434656] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.514205] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: SUCCESS [ 1048.514205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.685635] env[66519]: INFO networking_nsxv3.common.synchronization [None req-5341e816-bb33-46e0-8151-1420e2b47465 tempest-ServerActionsTestJSON-1487893254 tempest-ServerActionsTestJSON-1487893254-project-member] Enqueued Resource ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 with Priority: HIGHEST for action security_group_rules [ 1048.686066] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 with Priority: HIGHEST for action security_group_rules [ 1048.686413] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4ce9b9d-f478-407a-abb1-894afeb8d299 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.686514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.686555] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.686804] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.686882] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4ce9b9d-f478-407a-abb1-894afeb8d299',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.827115] env[66519]: INFO networking_nsxv3.common.synchronization [None req-caca5930-6af7-49fd-8bd4-b105246e1d8c tempest-ServerActionsTestJSON-1487893254 tempest-ServerActionsTestJSON-1487893254-project-member] Enqueued Resource ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 with Priority: HIGHEST for action security_group_rules [ 1048.827115] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 with Priority: HIGHEST for action security_group_rules [ 1048.827115] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4ce9b9d-f478-407a-abb1-894afeb8d299 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.827997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.940024] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.940024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.940024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.940024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.940024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.940024] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be updated. [ 1048.968781] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.968781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.968781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.968781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.968781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.978152] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: IN_PROGRESS for 2s [ 1049.211750] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.211901] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.211972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.212212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.213594] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.213594] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 already deleted. [ 1049.213594] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.213594] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.213594] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.213594] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4ce9b9d-f478-407a-abb1-894afeb8d299',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.424153] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-947 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.424153] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-947" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.424153] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-947" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.424153] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-947" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.424153] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.424153] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.424153] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.425035] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.425477] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.425829] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.428304] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.428304] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.428304] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.428304] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.428304] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.428304] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.446363] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.446681] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1049.446681] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.447421] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-947" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.447421] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-bc01cd10-ec7a-441f-b1b6-d25323c0db02 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.447421] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-bc01cd10-ec7a-441f-b1b6-d25323c0db02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.447421] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-bc01cd10-ec7a-441f-b1b6-d25323c0db02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.447715] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-bc01cd10-ec7a-441f-b1b6-d25323c0db02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.447841] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc01cd10-ec7a-441f-b1b6-d25323c0db02',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.616624] env[66519]: INFO networking_nsxv3.common.synchronization [req-fff55372-7037-41c5-bc36-9b03574827f0 req-c4281a96-bc44-42ca-9208-e8fb0a4bcf2f tempest-ServerRescueNegativeTestJSON-912870119 tempest-ServerRescueNegativeTestJSON-912870119-project-member] Enqueued Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGHEST for action security_group_members [ 1049.617239] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGHEST for action security_group_members [ 1049.617573] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.617703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.617770] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.618010] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.618279] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.618382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.618443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.618610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.618696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.618789] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.738145] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.738145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.738145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.738145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.738145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.738145] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 already deleted. [ 1049.738145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.953974] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.955534] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.955534] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.955852] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.956153] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.956517] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.958058] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.958058] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.958058] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.958058] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.958058] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.958329] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.958382] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.958708] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.959404] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.959404] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: bc01cd10-ec7a-441f-b1b6-d25323c0db02 is going to be updated. [ 1049.984371] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.984725] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.984978] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.985388] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.985705] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.986142] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-bc01cd10-ec7a-441f-b1b6-d25323c0db02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.122476] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.122698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.122774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.122977] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.123084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.123282] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.123382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.123443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.123597] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.123705] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.123774] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2713653c-36b0-489e-8ec3-6cae0694eead is going to be updated. [ 1050.151183] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.151316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.151646] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.151646] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.151779] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.160534] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2713653c-36b0-489e-8ec3-6cae0694eead in Status: IN_PROGRESS for 2s [ 1050.680951] env[66519]: INFO networking_nsxv3.common.synchronization [req-4e700ab1-f792-4e1e-9c8a-1b6dc6806566 req-1d187f4a-7719-4637-b61c-394c629ced5a service nova] Enqueued Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGHEST for action security_group_rules [ 1050.681310] env[66519]: INFO networking_nsxv3.common.synchronization [req-4e700ab1-f792-4e1e-9c8a-1b6dc6806566 req-1d187f4a-7719-4637-b61c-394c629ced5a service nova] Enqueued Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGHEST for action security_group_members [ 1050.681310] env[66519]: INFO networking_nsxv3.common.synchronization [req-4e700ab1-f792-4e1e-9c8a-1b6dc6806566 req-1d187f4a-7719-4637-b61c-394c629ced5a service nova] Enqueued Resource ID: bc01cd10-ec7a-441f-b1b6-d25323c0db02 with Priority: HIGHEST for action port [ 1050.681924] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGHEST for action security_group_rules [ 1050.682045] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGHEST for action security_group_members [ 1050.682738] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc01cd10-ec7a-441f-b1b6-d25323c0db02 with Priority: HIGHEST for action port [ 1050.683199] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.683199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.683199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.683366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.683366] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.684312] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b4e85b6-ed99-4ac0-9639-f46dc275381b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.684312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.684464] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.684533] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.684653] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.684745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.684803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.684941] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.685055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.685202] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.686199] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc01cd10-ec7a-441f-b1b6-d25323c0db02 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.692408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc01cd10-ec7a-441f-b1b6-d25323c0db02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.692408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc01cd10-ec7a-441f-b1b6-d25323c0db02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.692408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc01cd10-ec7a-441f-b1b6-d25323c0db02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.692408] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc01cd10-ec7a-441f-b1b6-d25323c0db02',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.717526] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.717851] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.717998] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.718528] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.718806] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.719085] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.719177] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.719409] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.719565] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.719779] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1050.719905] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1050.720018] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1050.720134] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1050.720255] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1050.720369] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1050.720506] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1050.740111] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1050.740331] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1050.740449] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1050.740621] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.740960] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-21d33aa8-67a2-49bc-927b-50ed1719ddd8 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.741161] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-21d33aa8-67a2-49bc-927b-50ed1719ddd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.741288] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-21d33aa8-67a2-49bc-927b-50ed1719ddd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.741621] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-21d33aa8-67a2-49bc-927b-50ed1719ddd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.741771] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21d33aa8-67a2-49bc-927b-50ed1719ddd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.991252] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: SUCCESS [ 1050.991252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.191698] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.192900] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b4e85b6-ed99-4ac0-9639-f46dc275381b taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.193066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.193134] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc01cd10-ec7a-441f-b1b6-d25323c0db02 with status ACTIVE [ 1051.193308] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.193408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.193474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.193685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.193769] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.193942] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.194088] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.194161] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.194417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.194417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.194662] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.194802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.194864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.195025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.195103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.195188] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc01cd10-ec7a-441f-b1b6-d25323c0db02 is going to be updated. [ 1051.231388] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.231549] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.231622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.231852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.232011] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.232179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc01cd10-ec7a-441f-b1b6-d25323c0db02" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.243921] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.244163] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.244289] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.244665] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.244758] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.244869] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 21d33aa8-67a2-49bc-927b-50ed1719ddd8 not found, creating... [ 1051.245164] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.245328] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.245445] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.245703] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.245830] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.246163] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.246326] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.246444] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.246771] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.246913] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.247069] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 21d33aa8-67a2-49bc-927b-50ed1719ddd8 is going to be created. [ 1051.268476] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.268713] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.268768] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.269132] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.269470] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.269805] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-21d33aa8-67a2-49bc-927b-50ed1719ddd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.697593] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.014697] env[66519]: INFO networking_nsxv3.common.synchronization [req-0c888171-f17e-4a34-872e-51583199317f req-16e191bb-bec4-428a-99ac-bee083fcf01c service nova] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_rules [ 1052.014697] env[66519]: INFO networking_nsxv3.common.synchronization [req-0c888171-f17e-4a34-872e-51583199317f req-16e191bb-bec4-428a-99ac-bee083fcf01c service nova] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1052.014697] env[66519]: INFO networking_nsxv3.common.synchronization [req-0c888171-f17e-4a34-872e-51583199317f req-16e191bb-bec4-428a-99ac-bee083fcf01c service nova] Enqueued Resource ID: 21d33aa8-67a2-49bc-927b-50ed1719ddd8 with Priority: HIGHEST for action port [ 1052.014697] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_rules [ 1052.014697] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1052.014973] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d33aa8-67a2-49bc-927b-50ed1719ddd8 with Priority: HIGHEST for action port [ 1052.015505] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.015591] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.015632] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.015840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.016333] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.017604] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.017687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.017730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.018100] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.018305] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.018417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.018482] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.018679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.018715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.018810] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.020144] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-21d33aa8-67a2-49bc-927b-50ed1719ddd8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.020215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21d33aa8-67a2-49bc-927b-50ed1719ddd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.020338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21d33aa8-67a2-49bc-927b-50ed1719ddd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.020516] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21d33aa8-67a2-49bc-927b-50ed1719ddd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.020592] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21d33aa8-67a2-49bc-927b-50ed1719ddd8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.172396] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2713653c-36b0-489e-8ec3-6cae0694eead in Status: SUCCESS [ 1052.172616] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2713653c-36b0-489e-8ec3-6cae0694eead deletion is rescheduled due to dependency. [ 1052.172728] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.200005] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.200217] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.200298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.200526] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.200618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.201162] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b is going to be updated. [ 1052.230080] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.230265] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.230325] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.230546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.230705] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.239718] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b in Status: IN_PROGRESS for 2s [ 1052.520422] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.522574] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21d33aa8-67a2-49bc-927b-50ed1719ddd8 with status ACTIVE [ 1052.523880] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.523880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.523880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.523880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.524290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.524524] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.524600] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.524787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.524832] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.524906] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.525439] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.525439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.525439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.525439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.525615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.525615] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21d33aa8-67a2-49bc-927b-50ed1719ddd8 is going to be updated. [ 1052.527496] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.527496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.553411] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.553567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.553612] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.554357] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.554357] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.554357] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21d33aa8-67a2-49bc-927b-50ed1719ddd8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.028326] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.531238] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.531429] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.531490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.532580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.532580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.532580] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be updated. [ 1053.564628] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.564781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.564855] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.565092] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.565241] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.575310] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: IN_PROGRESS for 2s [ 1054.249624] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b in Status: SUCCESS [ 1054.250196] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.250196] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.250542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.250656] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.250795] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.250884] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.251098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.251205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.251318] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.251433] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.753816] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.762941] env[66519]: INFO networking_nsxv3.common.synchronization [req-11ac5c76-a335-44ea-93fa-4ea3c59c8b8c req-f5951c98-1da6-48b9-9fd1-f29d9d6d1339 tempest-ServersTestJSON-971253557 tempest-ServersTestJSON-971253557-project-member] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1054.763494] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1054.763863] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.764030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.764090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.764398] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.764736] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.764858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.764925] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.765793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.765793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.765793] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.153031] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-450 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.153031] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.153031] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.153031] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.153031] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.153031] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.153031] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.153031] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.153031] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.153031] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1055.153031] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1055.153762] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1055.153762] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1055.153762] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1055.153762] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1055.153762] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1055.176581] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1055.176929] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1055.177014] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1055.177191] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.177665] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-88441f04-b731-4bad-a8aa-d7f2b52d1967 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.177810] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-88441f04-b731-4bad-a8aa-d7f2b52d1967" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.177916] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-88441f04-b731-4bad-a8aa-d7f2b52d1967" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.178423] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-88441f04-b731-4bad-a8aa-d7f2b52d1967" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.178528] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88441f04-b731-4bad-a8aa-d7f2b52d1967',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.256950] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b4e85b6-ed99-4ac0-9639-f46dc275381b: rpc.has_security_group_logging(os_id): False [ 1055.268807] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.277622] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.277914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.278085] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.278475] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.278475] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.278792] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.278902] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.279058] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.279208] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.279289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.279382] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b is going to be updated. [ 1055.373260] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.373260] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.373260] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.373710] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.373710] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.388433] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b in Status: IN_PROGRESS for 2s [ 1055.587543] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: SUCCESS [ 1055.587806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.588127] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.588370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.588579] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.588717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.588785] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.588962] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.589068] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.589198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.589309] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.685287] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.685287] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.685287] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.685287] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.685287] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.685287] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 88441f04-b731-4bad-a8aa-d7f2b52d1967 not found, creating... [ 1055.685287] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.685287] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.685287] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.685940] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.685940] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.686037] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.686203] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.686339] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.686580] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.686754] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.686905] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 88441f04-b731-4bad-a8aa-d7f2b52d1967 is going to be created. [ 1055.715761] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.716259] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.716329] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.716668] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.716923] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.717226] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-88441f04-b731-4bad-a8aa-d7f2b52d1967" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.771771] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.091337] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.091509] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.091582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.091824] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.091998] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.092126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.092196] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.092361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.092453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.092595] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.092840] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.093044] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.093145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.093316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.093471] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.093572] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.093638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.093784] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.093864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.093947] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.094080] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.277241] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.277241] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.277241] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.277241] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.277727] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.277727] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 1056.329815] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.329967] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.330048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.330271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.330469] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.340828] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 1056.477511] env[66519]: INFO networking_nsxv3.common.synchronization [req-11ac5c76-a335-44ea-93fa-4ea3c59c8b8c req-d034cea9-7adc-4eda-9ed7-0f767b39d9ec service nova] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_rules [ 1056.477628] env[66519]: INFO networking_nsxv3.common.synchronization [req-11ac5c76-a335-44ea-93fa-4ea3c59c8b8c req-d034cea9-7adc-4eda-9ed7-0f767b39d9ec service nova] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1056.477771] env[66519]: INFO networking_nsxv3.common.synchronization [req-11ac5c76-a335-44ea-93fa-4ea3c59c8b8c req-d034cea9-7adc-4eda-9ed7-0f767b39d9ec service nova] Enqueued Resource ID: 88441f04-b731-4bad-a8aa-d7f2b52d1967 with Priority: HIGHEST for action port [ 1056.478416] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_rules [ 1056.478557] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1056.478670] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88441f04-b731-4bad-a8aa-d7f2b52d1967 with Priority: HIGHEST for action port [ 1056.478994] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.479195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.479279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.479489] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.479572] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.480686] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.480686] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.480785] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-88441f04-b731-4bad-a8aa-d7f2b52d1967 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.480979] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88441f04-b731-4bad-a8aa-d7f2b52d1967" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.481063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88441f04-b731-4bad-a8aa-d7f2b52d1967" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.481247] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88441f04-b731-4bad-a8aa-d7f2b52d1967" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.481386] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88441f04-b731-4bad-a8aa-d7f2b52d1967',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.596088] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a5c9fd2-e0f8-469b-9019-610142582634: rpc.has_security_group_logging(os_id): False [ 1056.621743] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.621949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.621949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.622300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.622440] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.622676] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.622781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.622848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.623043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.623126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.623348] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.623461] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.623558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.623751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.623831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.624543] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.624722] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.624722] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.624864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.624927] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.625067] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be updated. [ 1056.699811] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.699971] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.700056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.700284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.700435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.720585] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: IN_PROGRESS for 2s [ 1056.983341] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.983503] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.983720] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88441f04-b731-4bad-a8aa-d7f2b52d1967 with status ACTIVE [ 1056.983892] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.983999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.984999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.984999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.984999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.984999] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.984999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.984999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.984999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.984999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.985360] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.985360] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.985360] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.985497] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.985567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.985652] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88441f04-b731-4bad-a8aa-d7f2b52d1967 is going to be updated. [ 1057.007880] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.008031] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.008176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.008331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.008471] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.008631] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88441f04-b731-4bad-a8aa-d7f2b52d1967" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.403523] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b in Status: SUCCESS [ 1057.403911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.049362] env[66519]: INFO networking_nsxv3.common.synchronization [req-a7b26f8f-76e6-42dd-9f71-e6f40adbebbb req-f428b34a-ba07-48d6-8ac9-551aa74f0058 tempest-ServerMetadataNegativeTestJSON-1003106220 tempest-ServerMetadataNegativeTestJSON-1003106220-project-member] Enqueued Resource ID: 2ce59d72-8fa4-451a-bee1-2baec693136d with Priority: HIGHEST for action security_group_members [ 1058.049914] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce59d72-8fa4-451a-bee1-2baec693136d with Priority: HIGHEST for action security_group_members [ 1058.050284] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce59d72-8fa4-451a-bee1-2baec693136d taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.050423] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.050488] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.050775] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.050935] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.051077] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.051170] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.051296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.051380] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.051494] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce59d72-8fa4-451a-bee1-2baec693136d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.353140] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 1058.353390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.353482] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.353714] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.353909] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.354037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.354106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.354259] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.354342] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.354444] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.412255] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-827 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.412618] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-827" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.412618] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-827" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.413274] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-827" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.413473] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.413691] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.413840] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.414113] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.414325] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.414583] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1058.414721] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1058.414853] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1058.415244] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1058.415486] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1058.415673] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1058.415881] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1058.443037] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1058.443037] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1058.443037] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1058.443363] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-827" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.443575] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-63b7051b-361e-4c50-95ff-a6069a40cd73 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.446950] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-63b7051b-361e-4c50-95ff-a6069a40cd73" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.446950] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-63b7051b-361e-4c50-95ff-a6069a40cd73" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.446950] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-63b7051b-361e-4c50-95ff-a6069a40cd73" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.446950] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63b7051b-361e-4c50-95ff-a6069a40cd73',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.553944] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.554856] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.554970] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.556369] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.556429] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.556736] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.556872] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.556872] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.557121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.557249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.557382] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce59d72-8fa4-451a-bee1-2baec693136d already deleted. [ 1058.557822] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.737372] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: SUCCESS [ 1058.737763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.856481] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.949240] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.949575] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.949770] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.950322] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.950322] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.950519] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 63b7051b-361e-4c50-95ff-a6069a40cd73 not found, creating... [ 1058.950776] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.951195] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.951195] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.951466] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.951466] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.951771] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.951946] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.952057] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.952340] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.952455] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.952561] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 63b7051b-361e-4c50-95ff-a6069a40cd73 is going to be created. [ 1058.977347] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.977607] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.977749] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.978149] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.978461] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.978758] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-63b7051b-361e-4c50-95ff-a6069a40cd73" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.359453] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.730828] env[66519]: INFO networking_nsxv3.common.synchronization [req-a7b26f8f-76e6-42dd-9f71-e6f40adbebbb req-7bf1a3af-80be-4691-bc66-38f090cc0b5f service nova] Enqueued Resource ID: 2ce59d72-8fa4-451a-bee1-2baec693136d with Priority: HIGHEST for action security_group_rules [ 1059.731119] env[66519]: INFO networking_nsxv3.common.synchronization [req-a7b26f8f-76e6-42dd-9f71-e6f40adbebbb req-7bf1a3af-80be-4691-bc66-38f090cc0b5f service nova] Enqueued Resource ID: 2ce59d72-8fa4-451a-bee1-2baec693136d with Priority: HIGHEST for action security_group_members [ 1059.731219] env[66519]: INFO networking_nsxv3.common.synchronization [req-a7b26f8f-76e6-42dd-9f71-e6f40adbebbb req-7bf1a3af-80be-4691-bc66-38f090cc0b5f service nova] Enqueued Resource ID: 63b7051b-361e-4c50-95ff-a6069a40cd73 with Priority: HIGHEST for action port [ 1059.731738] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce59d72-8fa4-451a-bee1-2baec693136d with Priority: HIGHEST for action security_group_rules [ 1059.731898] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce59d72-8fa4-451a-bee1-2baec693136d with Priority: HIGHEST for action security_group_members [ 1059.732019] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b7051b-361e-4c50-95ff-a6069a40cd73 with Priority: HIGHEST for action port [ 1059.732296] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ce59d72-8fa4-451a-bee1-2baec693136d taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.732417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.732480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.732793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.732862] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ce59d72-8fa4-451a-bee1-2baec693136d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.733710] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce59d72-8fa4-451a-bee1-2baec693136d taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.733807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.733875] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.734051] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.734220] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.734326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.734388] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.734541] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.734624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.734712] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce59d72-8fa4-451a-bee1-2baec693136d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.735477] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-63b7051b-361e-4c50-95ff-a6069a40cd73 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.735582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63b7051b-361e-4c50-95ff-a6069a40cd73" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.735675] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63b7051b-361e-4c50-95ff-a6069a40cd73" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.735810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63b7051b-361e-4c50-95ff-a6069a40cd73" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.735894] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63b7051b-361e-4c50-95ff-a6069a40cd73',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.864030] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.864170] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.864170] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.864345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.864439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.864538] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 1059.904344] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.904528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.904528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.904680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.904816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.917760] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 1060.239789] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce59d72-8fa4-451a-bee1-2baec693136d taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.240014] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.240251] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ce59d72-8fa4-451a-bee1-2baec693136d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.241613] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63b7051b-361e-4c50-95ff-a6069a40cd73 with status ACTIVE [ 1060.241716] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.241980] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.242089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.242313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.242401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.242662] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.242831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.242871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.243192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.243277] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.243427] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.243526] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.243588] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.243777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.243887] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.243984] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63b7051b-361e-4c50-95ff-a6069a40cd73 is going to be updated. [ 1060.268335] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.268335] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.268335] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.268552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.268662] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.269586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63b7051b-361e-4c50-95ff-a6069a40cd73" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.271376] env[66519]: INFO networking_nsxv3.common.synchronization [req-e19a3672-bca4-4462-9399-bb284874ade7 req-c1cf484f-c137-4922-bf49-c71ec995a6d8 tempest-DeleteServersTestJSON-1278201394 tempest-DeleteServersTestJSON-1278201394-project-member] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1060.271823] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1060.272182] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.272460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.272460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.272660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.272959] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.273115] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.273188] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.273458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.273574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.273677] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.522059] env[66519]: INFO networking_nsxv3.common.synchronization [req-409ff37b-4cb8-4d8d-84b3-3cea48eac587 req-0d982c0b-2ee2-442d-ae1d-6ef24029cb55 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1060.522799] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1060.523071] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.523196] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.523262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.523688] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.523688] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.523816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.523852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.523994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.524105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.524206] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.746199] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ce59d72-8fa4-451a-bee1-2baec693136d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.776135] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.777153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.777153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.777153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.777153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.777742] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.777742] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.777742] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.777742] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.777742] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.777993] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1060.808916] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.808916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.808916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.808916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.808916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.818307] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1060.853465] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.853660] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-582" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.853791] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-582" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.854144] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-582" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.854469] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.854637] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.854752] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.854971] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.855138] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.855345] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1060.855457] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1060.855562] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1060.855779] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1060.856039] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1060.856190] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1060.856334] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1060.875997] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1060.876299] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1060.876461] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1060.876639] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-582" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.877069] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.877229] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.877357] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.877766] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.877935] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.027686] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.027828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.027902] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.028191] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.028311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.028545] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.028784] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.028784] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.028923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.028996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.029105] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 already deleted. [ 1061.029188] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.248734] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.248734] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.248734] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.249024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.249090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.249153] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce59d72-8fa4-451a-bee1-2baec693136d is going to be created. [ 1061.282438] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.282687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.282761] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.283081] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.283297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.297143] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce59d72-8fa4-451a-bee1-2baec693136d in Status: UNINITIALIZED for 2s [ 1061.384199] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.384460] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.384591] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.384891] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.385110] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.385355] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b not found, creating... [ 1061.385748] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.385950] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.386181] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.386488] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.386663] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.387040] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.387249] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.387452] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.387654] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.387789] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.387927] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b is going to be created. [ 1061.413072] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.413544] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.413751] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.414160] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.414458] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.414704] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.929315] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 1061.929315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.929315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.929824] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.929824] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.929824] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.929824] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.930031] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.930031] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.930182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.930182] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.158298] env[66519]: INFO networking_nsxv3.common.synchronization [req-409ff37b-4cb8-4d8d-84b3-3cea48eac587 req-09094e7b-273d-415f-b797-de1a4b5a5877 service nova] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_rules [ 1062.158493] env[66519]: INFO networking_nsxv3.common.synchronization [req-409ff37b-4cb8-4d8d-84b3-3cea48eac587 req-09094e7b-273d-415f-b797-de1a4b5a5877 service nova] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1062.158633] env[66519]: INFO networking_nsxv3.common.synchronization [req-409ff37b-4cb8-4d8d-84b3-3cea48eac587 req-09094e7b-273d-415f-b797-de1a4b5a5877 service nova] Enqueued Resource ID: f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b with Priority: HIGHEST for action port [ 1062.159203] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_rules [ 1062.159405] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1062.159617] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b with Priority: HIGHEST for action port [ 1062.160148] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.160148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.160148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.160481] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.160481] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.161553] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.161553] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.161753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.161797] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.161939] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.162041] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.162105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.162435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.162435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.162435] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.164073] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.164073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.164073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.164073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.164073] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.433224] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.433675] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.433957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.434391] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.435052] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.435052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.435052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.435052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.435311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.435311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.435471] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.435575] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.435645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.435799] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.435941] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.436078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.436191] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.436268] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.436348] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.436433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.436527] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.665424] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.665624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.665893] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.666851] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b with status ACTIVE [ 1062.667061] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.667249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.667249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.667455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.667548] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.667723] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.668844] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.669285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.669636] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.669755] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.670040] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.670326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.670379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.670605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.670740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.670870] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b is going to be updated. [ 1062.695146] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.695146] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.695146] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.695146] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.695329] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.695467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.831330] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1062.831540] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e deletion is rescheduled due to dependency. [ 1062.831666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.939278] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb1cadf6-d26e-4714-b83e-0fcbe235e2e5: rpc.has_security_group_logging(os_id): False [ 1062.960048] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.960296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.960296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.960614] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.960737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.961016] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.961098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.961148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.961322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.961402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.961703] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.961888] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.961997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.962229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.962350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.962674] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.962817] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.962919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.963165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.963288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.963387] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 1063.033379] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.033626] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.033714] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.033922] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.034166] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.057333] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 1063.174110] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.308829] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce59d72-8fa4-451a-bee1-2baec693136d in Status: SUCCESS [ 1063.309206] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.309406] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.309665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.309918] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.310107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.310203] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.310428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.310518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.310629] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.310724] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ce59d72-8fa4-451a-bee1-2baec693136d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.465928] env[66519]: INFO networking_nsxv3.common.synchronization [req-d6bded37-2e77-45e7-8d8a-32291df7b4ea req-363737f9-0666-49dd-922b-a44c18e5f27e tempest-ServerActionsTestOtherB-865317477 tempest-ServerActionsTestOtherB-865317477-project-member] Enqueued Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 1063.466791] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 1063.467379] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.467379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.468260] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.468260] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.468260] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.468260] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.468260] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.468598] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.468598] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.468598] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.676442] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.676625] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.676698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.676927] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.677049] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.677125] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be created. [ 1063.712860] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.712860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.713096] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.713144] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.713309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.731455] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: UNINITIALIZED for 2s [ 1063.814636] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce59d72-8fa4-451a-bee1-2baec693136d taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.815193] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.815367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.820112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.820112] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.820112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.820112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.820112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.820112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.820112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.820112] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce59d72-8fa4-451a-bee1-2baec693136d taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.820112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.820112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.820112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.820112] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.820112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.820112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.820112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.820112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.820112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.820112] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ce59d72-8fa4-451a-bee1-2baec693136d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.971118] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.971417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.971490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.974280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.974472] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.974798] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.974926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.974984] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.975193] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.975305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.975415] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee is going to be updated. [ 1064.013019] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.013019] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.013019] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.013019] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.013019] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.023935] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: IN_PROGRESS for 2s [ 1064.322474] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ce59d72-8fa4-451a-bee1-2baec693136d: rpc.has_security_group_logging(os_id): False [ 1064.348321] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.348321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.348321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.348321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.348321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.348321] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.348321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.348321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.348628] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.348628] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.348758] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.348806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.348876] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.349046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.349083] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.350183] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.350336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.350401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.350576] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.350654] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.350760] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ce59d72-8fa4-451a-bee1-2baec693136d is going to be created. [ 1064.428430] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.428639] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.428752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.428961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.429862] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.444434] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce59d72-8fa4-451a-bee1-2baec693136d in Status: IN_PROGRESS for 2s [ 1064.694198] env[66519]: INFO networking_nsxv3.common.synchronization [req-3bda40d5-03e2-4afc-8bfb-fefecd85b2f3 req-400ce711-d6a2-4f70-a153-879eafa4a717 tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1064.694931] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1064.694931] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.695079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.695079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.695327] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.695509] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.695600] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.695664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.695982] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.695982] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.696240] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.045138] env[66519]: INFO networking_nsxv3.common.synchronization [req-b7e14fb1-fd36-4ecd-90d0-3fd2371a1fc1 req-5f8ade17-83e9-4665-91b6-dccb28c6d307 tempest-ServerActionsTestJSON-1487893254 tempest-ServerActionsTestJSON-1487893254-project-member] Enqueued Resource ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 with Priority: HIGHEST for action security_group_members [ 1065.045804] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 with Priority: HIGHEST for action security_group_members [ 1065.046202] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ce9b9d-f478-407a-abb1-894afeb8d299 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.046313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.046379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.046642] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.046793] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.046892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.046953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.047313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.047466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.047604] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ce9b9d-f478-407a-abb1-894afeb8d299',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.082140] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 1065.082962] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.204849] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.389138] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.389355] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.389471] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.389754] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.390062] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.390182] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.390289] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.390498] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.390634] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.390835] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.390944] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.391058] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.391164] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.391266] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.391370] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.391539] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.411592] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.411792] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1065.411897] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.412094] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.412511] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-af5924fb-c93a-43cd-8fbb-2e4fe5c21cb3 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.412630] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-af5924fb-c93a-43cd-8fbb-2e4fe5c21cb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.412769] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-af5924fb-c93a-43cd-8fbb-2e4fe5c21cb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.413117] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-af5924fb-c93a-43cd-8fbb-2e4fe5c21cb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.413262] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af5924fb-c93a-43cd-8fbb-2e4fe5c21cb3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.432222] env[66519]: INFO networking_nsxv3.common.synchronization [None req-dcd739de-eeca-4d35-993b-d83d3747790e tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1065.432718] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1065.433408] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.433408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.551562] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.551804] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.551804] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.552117] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.552298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.552576] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.552726] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.552807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.553038] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.553141] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.553242] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 already deleted. [ 1065.553370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.706826] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.744741] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: SUCCESS [ 1065.745101] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.745303] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.745576] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.745803] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.746185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.746185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.746356] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.746395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.746517] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.746649] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.915905] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.916227] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.916377] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.916689] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.916928] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.917125] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port af5924fb-c93a-43cd-8fbb-2e4fe5c21cb3 not found, creating... [ 1065.917511] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.917803] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.917871] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.918086] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.918268] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.918610] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.918751] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.918848] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.919118] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.919265] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.919407] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: af5924fb-c93a-43cd-8fbb-2e4fe5c21cb3 is going to be created. [ 1065.943064] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.943310] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.943472] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.943758] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.944811] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.944811] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-af5924fb-c93a-43cd-8fbb-2e4fe5c21cb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.035324] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: SUCCESS [ 1066.035608] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee deletion is rescheduled due to dependency. [ 1066.035811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.209682] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.210020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.210090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.210410] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.210566] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.210742] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be updated. [ 1066.244019] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.244161] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.244213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.244433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.244761] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.249464] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.249596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.249662] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.249857] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.250034] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.250136] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.250228] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.250371] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.250451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.250651] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.250782] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.250877] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.250938] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.251091] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.251231] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.251327] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.251393] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.251532] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.251605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.251684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.251774] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.259238] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: IN_PROGRESS for 2s [ 1066.458073] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ce59d72-8fa4-451a-bee1-2baec693136d in Status: SUCCESS [ 1066.462373] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.680259] env[66519]: INFO networking_nsxv3.common.synchronization [req-b7e14fb1-fd36-4ecd-90d0-3fd2371a1fc1 req-1797b33e-fe73-442a-94ab-46e6e9c1673a service nova] Enqueued Resource ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 with Priority: HIGHEST for action security_group_rules [ 1066.680259] env[66519]: INFO networking_nsxv3.common.synchronization [req-b7e14fb1-fd36-4ecd-90d0-3fd2371a1fc1 req-1797b33e-fe73-442a-94ab-46e6e9c1673a service nova] Enqueued Resource ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 with Priority: HIGHEST for action security_group_members [ 1066.680259] env[66519]: INFO networking_nsxv3.common.synchronization [req-b7e14fb1-fd36-4ecd-90d0-3fd2371a1fc1 req-1797b33e-fe73-442a-94ab-46e6e9c1673a service nova] Enqueued Resource ID: af5924fb-c93a-43cd-8fbb-2e4fe5c21cb3 with Priority: HIGHEST for action port [ 1066.680259] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 with Priority: HIGHEST for action security_group_rules [ 1066.680259] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 with Priority: HIGHEST for action security_group_members [ 1066.680259] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af5924fb-c93a-43cd-8fbb-2e4fe5c21cb3 with Priority: HIGHEST for action port [ 1066.680259] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4ce9b9d-f478-407a-abb1-894afeb8d299 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.681350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.681399] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.681638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.681728] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4ce9b9d-f478-407a-abb1-894afeb8d299',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.682698] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ce9b9d-f478-407a-abb1-894afeb8d299 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.682813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.682882] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.683064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.683226] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.683555] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.683555] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.683555] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.683670] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.683743] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ce9b9d-f478-407a-abb1-894afeb8d299',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.684533] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-af5924fb-c93a-43cd-8fbb-2e4fe5c21cb3 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.686491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af5924fb-c93a-43cd-8fbb-2e4fe5c21cb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.686491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af5924fb-c93a-43cd-8fbb-2e4fe5c21cb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.686491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af5924fb-c93a-43cd-8fbb-2e4fe5c21cb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.686491] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af5924fb-c93a-43cd-8fbb-2e4fe5c21cb3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.755665] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4947ab6-b221-4af2-81e1-008fe8a07c25: rpc.has_security_group_logging(os_id): False [ 1066.781104] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.781361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.781474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.781810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.781992] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.782262] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.782455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.782548] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.782795] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.782883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.783171] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.783283] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.783350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.783782] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.783914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.784277] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.784393] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.784460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.784646] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.784743] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.784866] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be created. [ 1066.849691] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.852024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.852024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.852024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.852024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.862522] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: IN_PROGRESS for 2s [ 1067.188104] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4ce9b9d-f478-407a-abb1-894afeb8d299',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.188679] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ce9b9d-f478-407a-abb1-894afeb8d299 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.188825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.189266] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af5924fb-c93a-43cd-8fbb-2e4fe5c21cb3 with status ACTIVE [ 1067.189435] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.189542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.189605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.189833] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.189923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.190172] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.190298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.190360] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.190649] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.190649] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.191284] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.191284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.191284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.191284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.191457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.191494] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af5924fb-c93a-43cd-8fbb-2e4fe5c21cb3 is going to be updated. [ 1067.214862] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.215226] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.215226] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.215375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.216347] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.216347] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af5924fb-c93a-43cd-8fbb-2e4fe5c21cb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.690204] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4ce9b9d-f478-407a-abb1-894afeb8d299',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.193956] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.193956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.193956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.193956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.194191] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.194191] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 is going to be created. [ 1068.223470] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.223858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.223858] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.224272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.224595] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.238538] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 in Status: UNINITIALIZED for 2s [ 1068.270925] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: SUCCESS [ 1068.272043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.272043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.272043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.272043] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.272043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.272387] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.272387] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.272538] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.272729] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.735903] env[66519]: INFO networking_nsxv3.common.synchronization [req-a640e40c-655a-493e-bc77-275a927b767e req-f4e3c746-3930-47de-a480-387e07c021e1 tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 with Priority: HIGHEST for action security_group_members [ 1068.736637] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 with Priority: HIGHEST for action security_group_members [ 1068.737840] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.738101] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.738292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.738579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.739341] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.739341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.739341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.739341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.739341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.739694] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c204b4b3-a1d5-4736-9d79-b4de3adce0c8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.777981] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.777981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.777981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.777981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.777981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.777981] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.777981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.777981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.777981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.777981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.778622] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be updated. [ 1068.813926] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.814325] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.814325] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.814431] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.814671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.825480] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: IN_PROGRESS for 2s [ 1068.879103] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: SUCCESS [ 1068.879959] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.242745] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.243358] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.243358] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.243358] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.271124] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.271419] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.271633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.271670] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.271978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.272149] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.272256] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 is going to be updated. [ 1069.327758] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.328184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.328184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.328382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.328537] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.340629] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 in Status: IN_PROGRESS for 2s [ 1070.248375] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 in Status: SUCCESS [ 1070.248716] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.248924] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.249211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.249439] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.249562] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.249639] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.249870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.249968] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.250079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.250176] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4ce9b9d-f478-407a-abb1-894afeb8d299',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.339737] env[66519]: INFO networking_nsxv3.common.synchronization [req-536e6772-d9dd-45e9-aa52-3a0097703a10 req-59bf08f2-ffe3-4e65-a15f-1d3d29fd833a tempest-ServersTestJSON-971253557 tempest-ServersTestJSON-971253557-project-member] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1070.340911] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1070.340911] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.340911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.340911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.341178] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.341306] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.341411] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.341480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.341658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.341750] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.341845] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.752272] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4ce9b9d-f478-407a-abb1-894afeb8d299',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.836949] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: SUCCESS [ 1070.837171] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 deletion is rescheduled due to dependency. [ 1070.837293] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.843789] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.254917] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4ce9b9d-f478-407a-abb1-894afeb8d299: rpc.has_security_group_logging(os_id): False [ 1071.275902] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.276072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.276125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.276353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.276443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.276691] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.276792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.276849] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.277104] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.277185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.277278] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 is going to be created. [ 1071.347154] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.355191] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 in Status: SUCCESS [ 1071.355293] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 deletion is rescheduled due to dependency. [ 1071.355360] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.364732] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.364933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.364994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.365249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.365451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.385116] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 in Status: IN_PROGRESS for 2s [ 1071.849801] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.849801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.849959] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.850169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.850262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.850406] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 1071.890946] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.891118] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.891195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.891421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.891592] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.902807] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 1072.480561] env[66519]: INFO networking_nsxv3.common.synchronization [req-e368b4fe-e299-426a-89de-86ece72825a5 req-ebea1698-4a78-40cd-b713-b431e6269d74 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1072.480933] env[66519]: INFO networking_nsxv3.common.synchronization [req-e368b4fe-e299-426a-89de-86ece72825a5 req-ebea1698-4a78-40cd-b713-b431e6269d74 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 with Priority: HIGHEST for action security_group_members [ 1072.481499] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1072.481735] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 with Priority: HIGHEST for action security_group_members [ 1072.482060] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.482185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.482253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.482454] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.482612] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.482728] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.482812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.482913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.483107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.483107] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.485186] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a51e17dc-f2f0-443a-9853-7cd6fa24da87 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.485305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.485393] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.485682] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.485845] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.485949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.486033] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.486469] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.486469] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.486469] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.528329] env[66519]: INFO networking_nsxv3.common.synchronization [req-e368b4fe-e299-426a-89de-86ece72825a5 req-ebea1698-4a78-40cd-b713-b431e6269d74 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 with Priority: HIGHEST for action security_group_rules [ 1072.528514] env[66519]: INFO networking_nsxv3.common.synchronization [req-e368b4fe-e299-426a-89de-86ece72825a5 req-ebea1698-4a78-40cd-b713-b431e6269d74 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 with Priority: HIGHEST for action security_group_members [ 1072.528652] env[66519]: INFO networking_nsxv3.common.synchronization [req-e368b4fe-e299-426a-89de-86ece72825a5 req-ebea1698-4a78-40cd-b713-b431e6269d74 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_rules [ 1072.528874] env[66519]: INFO networking_nsxv3.common.synchronization [req-e368b4fe-e299-426a-89de-86ece72825a5 req-ebea1698-4a78-40cd-b713-b431e6269d74 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1072.529083] env[66519]: INFO networking_nsxv3.common.synchronization [req-e368b4fe-e299-426a-89de-86ece72825a5 req-ebea1698-4a78-40cd-b713-b431e6269d74 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b with Priority: HIGHEST for action port [ 1072.530066] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 with Priority: HIGHEST for action security_group_rules [ 1072.530341] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_rules [ 1072.530393] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b with Priority: HIGHEST for action port [ 1072.530558] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 with Priority: HIGHEST for action security_group_members [ 1072.530675] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1072.530965] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a51e17dc-f2f0-443a-9853-7cd6fa24da87 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.531140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.531252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.531603] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.531691] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.532637] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.532841] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.532943] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.533137] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.533211] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.534348] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.534480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.534586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.534754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.534868] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.535594] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a51e17dc-f2f0-443a-9853-7cd6fa24da87 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.535682] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.536542] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.536542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.845070] env[66519]: INFO networking_nsxv3.common.synchronization [req-cf28e306-a2a4-4f8e-8227-ac94cb356964 req-28f63443-81d3-45fa-ba69-e5f431395622 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f with Priority: HIGHEST for action security_group_members [ 1072.845070] env[66519]: INFO networking_nsxv3.common.synchronization [req-cf28e306-a2a4-4f8e-8227-ac94cb356964 req-28f63443-81d3-45fa-ba69-e5f431395622 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1072.845256] env[66519]: INFO networking_nsxv3.common.synchronization [req-cf28e306-a2a4-4f8e-8227-ac94cb356964 req-28f63443-81d3-45fa-ba69-e5f431395622 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 with Priority: HIGHEST for action security_group_members [ 1072.845993] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f with Priority: HIGHEST for action security_group_members [ 1072.846235] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1072.846469] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 with Priority: HIGHEST for action security_group_members [ 1072.846806] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.846989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.847135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.847513] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.847764] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.847928] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.848050] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.848348] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.848495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.848649] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ac79ffc-f04a-42fd-81ac-d6a0498a399f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.850391] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.850540] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.850840] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a51e17dc-f2f0-443a-9853-7cd6fa24da87 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.850978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.888886] env[66519]: INFO networking_nsxv3.common.synchronization [req-cf28e306-a2a4-4f8e-8227-ac94cb356964 req-28f63443-81d3-45fa-ba69-e5f431395622 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f with Priority: HIGHEST for action security_group_rules [ 1072.889065] env[66519]: INFO networking_nsxv3.common.synchronization [req-cf28e306-a2a4-4f8e-8227-ac94cb356964 req-28f63443-81d3-45fa-ba69-e5f431395622 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f with Priority: HIGHEST for action security_group_members [ 1072.889201] env[66519]: INFO networking_nsxv3.common.synchronization [req-cf28e306-a2a4-4f8e-8227-ac94cb356964 req-28f63443-81d3-45fa-ba69-e5f431395622 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 with Priority: HIGHEST for action security_group_rules [ 1072.889470] env[66519]: INFO networking_nsxv3.common.synchronization [req-cf28e306-a2a4-4f8e-8227-ac94cb356964 req-28f63443-81d3-45fa-ba69-e5f431395622 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 with Priority: HIGHEST for action security_group_members [ 1072.889673] env[66519]: INFO networking_nsxv3.common.synchronization [req-cf28e306-a2a4-4f8e-8227-ac94cb356964 req-28f63443-81d3-45fa-ba69-e5f431395622 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_rules [ 1072.889812] env[66519]: INFO networking_nsxv3.common.synchronization [req-cf28e306-a2a4-4f8e-8227-ac94cb356964 req-28f63443-81d3-45fa-ba69-e5f431395622 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1072.889939] env[66519]: INFO networking_nsxv3.common.synchronization [req-cf28e306-a2a4-4f8e-8227-ac94cb356964 req-28f63443-81d3-45fa-ba69-e5f431395622 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b with Priority: HIGHEST for action port [ 1072.891073] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f with Priority: HIGHEST for action security_group_rules [ 1072.891073] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 with Priority: HIGHEST for action security_group_rules [ 1072.891073] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1072.891073] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b with Priority: HIGHEST for action port [ 1072.891073] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_rules [ 1072.891502] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f with Priority: HIGHEST for action security_group_members [ 1072.891502] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 with Priority: HIGHEST for action security_group_members [ 1072.891570] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ac79ffc-f04a-42fd-81ac-d6a0498a399f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.891629] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.891703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.891981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.892080] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ac79ffc-f04a-42fd-81ac-d6a0498a399f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.892914] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a51e17dc-f2f0-443a-9853-7cd6fa24da87 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.893021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.893227] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.893422] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.893493] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.893551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.893719] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.893835] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.894064] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.894812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.894812] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a51e17dc-f2f0-443a-9853-7cd6fa24da87 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.894812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.986293] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.988247] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.036924] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a51e17dc-f2f0-443a-9853-7cd6fa24da87 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.037056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.038661] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.038833] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.038992] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b with status ACTIVE [ 1073.039184] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.039347] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.039474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.039638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.039741] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.039925] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.040047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.041023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.041023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.041023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.041023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.041023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.041023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.041023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.041023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.041268] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b is going to be updated. [ 1073.065151] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.065151] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.065151] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.065151] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.066322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.066322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.066322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.066322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.066322] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.244966] env[66519]: INFO networking_nsxv3.common.synchronization [req-fc6c5868-d79c-4333-abfc-6e8c1b44176b req-57000add-872b-4543-ac3c-91f6019a0f98 tempest-DeleteServersTestJSON-1278201394 tempest-DeleteServersTestJSON-1278201394-project-member] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1073.245665] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1073.246062] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.246213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.246365] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.246589] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.246784] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.246907] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.246990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.247244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.247298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.247400] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.352433] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ac79ffc-f04a-42fd-81ac-d6a0498a399f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.396546] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.396725] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.400237] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 in Status: SUCCESS [ 1073.400237] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.489150] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.490490] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.571235] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b with status ACTIVE [ 1073.571469] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.571613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.571686] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.571941] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.572080] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.572302] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.572424] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.572493] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.572704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.572895] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.573136] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.573314] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.573439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.573720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.573816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.573910] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b is going to be updated. [ 1073.598066] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.598066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.598066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.598066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.598066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.598066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8ea0b0f-78b3-4c2a-b731-ede6d0463a9b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.607801] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-42 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.607987] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.608166] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.608464] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.608729] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.608885] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.609461] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.609461] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.609461] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.609798] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.609798] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1073.609895] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1073.610294] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1073.610294] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.610294] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1073.610394] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1073.634406] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1073.634682] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1073.634830] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1073.635010] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.635333] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-d858b497-ef2a-49c1-9efc-4843723e026a taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.635506] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-d858b497-ef2a-49c1-9efc-4843723e026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.635622] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-d858b497-ef2a-49c1-9efc-4843723e026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.635948] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-d858b497-ef2a-49c1-9efc-4843723e026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.636115] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d858b497-ef2a-49c1-9efc-4843723e026a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.749743] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.749992] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.750090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.750386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.750503] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.750844] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.751198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.751322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.751538] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.751649] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.751745] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1073.784408] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.784585] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.784649] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.785986] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.785986] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.795808] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1073.859345] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ac79ffc-f04a-42fd-81ac-d6a0498a399f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.914223] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 1073.914557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.992793] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.993258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.993258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.993338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.993408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.993540] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be updated. [ 1073.995294] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.995453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.995544] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.995766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.995874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.995990] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 is going to be created. [ 1074.028612] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.028822] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.028822] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.029096] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.029216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.033031] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.033031] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.033227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.033403] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.033963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.043732] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 in Status: UNINITIALIZED for 2s [ 1074.045426] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: IN_PROGRESS for 2s [ 1074.141023] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.141023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.141023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.141023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.141023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.141023] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port d858b497-ef2a-49c1-9efc-4843723e026a not found, creating... [ 1074.141023] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.141023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.141023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.141023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.141023] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.141774] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.142211] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.142508] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.142942] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.143355] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.143688] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: d858b497-ef2a-49c1-9efc-4843723e026a is going to be created. [ 1074.171310] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.171310] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.171310] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.171310] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.171310] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.171310] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-d858b497-ef2a-49c1-9efc-4843723e026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.361416] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.361679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.361679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.361900] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.362024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.362096] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f is going to be created. [ 1074.387755] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.387973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.388098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.388235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.388492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.398420] env[66519]: INFO networking_nsxv3.common.synchronization [req-63353179-1c52-4d57-8be1-4ed501f9d617 req-97a516fb-6726-4571-8fab-09214283a684 tempest-ServerMetadataNegativeTestJSON-1003106220 tempest-ServerMetadataNegativeTestJSON-1003106220-project-member] Enqueued Resource ID: 2ce59d72-8fa4-451a-bee1-2baec693136d with Priority: HIGHEST for action security_group_members [ 1074.398984] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce59d72-8fa4-451a-bee1-2baec693136d with Priority: HIGHEST for action security_group_members [ 1074.399411] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ce59d72-8fa4-451a-bee1-2baec693136d taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.399548] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.399616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.399819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.399969] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.400188] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.400188] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.400261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.400343] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.400435] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ce59d72-8fa4-451a-bee1-2baec693136d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.402306] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f in Status: UNINITIALIZED for 2s [ 1074.697970] env[66519]: INFO networking_nsxv3.common.synchronization [None req-9928c6fd-b2a5-4597-a982-73cb5fca4a6f tempest-AttachVolumeNegativeTest-1001897465 tempest-AttachVolumeNegativeTest-1001897465-project-member] Enqueued Resource ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa with Priority: HIGHEST for action security_group_rules [ 1074.698569] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa with Priority: HIGHEST for action security_group_rules [ 1074.698989] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.698989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.699582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.699930] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.700096] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4090bc61-1cc1-4db7-9c78-0f0fabacd9aa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.884551] env[66519]: INFO networking_nsxv3.common.synchronization [req-fc6c5868-d79c-4333-abfc-6e8c1b44176b req-65a19067-4494-48cf-963e-a291476a2870 service nova] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_rules [ 1074.884742] env[66519]: INFO networking_nsxv3.common.synchronization [req-fc6c5868-d79c-4333-abfc-6e8c1b44176b req-65a19067-4494-48cf-963e-a291476a2870 service nova] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1074.885435] env[66519]: INFO networking_nsxv3.common.synchronization [req-fc6c5868-d79c-4333-abfc-6e8c1b44176b req-65a19067-4494-48cf-963e-a291476a2870 service nova] Enqueued Resource ID: d858b497-ef2a-49c1-9efc-4843723e026a with Priority: HIGHEST for action port [ 1074.885435] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_rules [ 1074.885649] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1074.887025] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d858b497-ef2a-49c1-9efc-4843723e026a with Priority: HIGHEST for action port [ 1074.887025] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.887025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.887025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.887025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.887025] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.888692] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.888692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.888692] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-d858b497-ef2a-49c1-9efc-4843723e026a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.888692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d858b497-ef2a-49c1-9efc-4843723e026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.888692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d858b497-ef2a-49c1-9efc-4843723e026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.888692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d858b497-ef2a-49c1-9efc-4843723e026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.888692] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d858b497-ef2a-49c1-9efc-4843723e026a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.900888] env[66519]: INFO networking_nsxv3.common.synchronization [None req-60df2b27-674e-4866-bc5f-c77c732e3ff9 tempest-AttachVolumeNegativeTest-1001897465 tempest-AttachVolumeNegativeTest-1001897465-project-member] Enqueued Resource ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa with Priority: HIGHEST for action security_group_rules [ 1074.903805] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa with Priority: HIGHEST for action security_group_rules [ 1074.904586] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.904831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.904831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.904998] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.905094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.905280] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.905387] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.905439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.905583] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.905657] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.905738] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce59d72-8fa4-451a-bee1-2baec693136d is going to be updated. [ 1074.907359] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.907454] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.937604] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.937604] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.937604] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.937845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.937976] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.949017] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce59d72-8fa4-451a-bee1-2baec693136d in Status: IN_PROGRESS for 2s [ 1075.222024] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.222765] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.222910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.223198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.223349] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.223491] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa already deleted. [ 1075.223615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.223845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.224083] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.224246] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4090bc61-1cc1-4db7-9c78-0f0fabacd9aa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.390640] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.390640] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.390640] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d858b497-ef2a-49c1-9efc-4843723e026a with status ACTIVE [ 1075.390908] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.390908] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.391040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.391269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.391347] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.391863] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.391863] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.391863] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.392063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.392063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.392215] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.393377] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.393377] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.393377] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.393377] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.393377] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d858b497-ef2a-49c1-9efc-4843723e026a is going to be updated. [ 1075.423134] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.423438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.423551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.423800] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.423933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.424119] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d858b497-ef2a-49c1-9efc-4843723e026a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.751954] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.752486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.752486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.752610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.752832] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.752893] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa already deleted. [ 1075.753154] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.808059] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1075.808059] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e deletion is rescheduled due to dependency. [ 1075.808059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.808059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.808059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.808059] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.808059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.808059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.808059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.808059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.808059] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.811169] env[66519]: INFO networking_nsxv3.common.synchronization [req-80fccda2-1751-47df-a8e2-3833bed457c2 req-4374a5f6-b033-4dac-927b-acccf09d87b7 tempest-ServerActionsTestOtherB-865317477 tempest-ServerActionsTestOtherB-865317477-project-member] Enqueued Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 1075.813242] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 1075.813584] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.813698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.813767] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.813974] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.814127] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.814229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.814293] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.814507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.814687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.814788] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.056745] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 in Status: SUCCESS [ 1076.057475] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.057475] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.057475] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.057702] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.057805] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.057869] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.058043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.058128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.058232] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.062030] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: SUCCESS [ 1076.062030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.062183] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.062480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.062662] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.063036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.063036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.063118] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.063294] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.063535] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.161346] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-806 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.161655] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-806" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.161854] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-806" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.162178] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-806" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.162555] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.162801] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.162962] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.163280] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.163456] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.163733] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1076.163892] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1076.164039] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1076.164164] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1076.164342] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1076.164518] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1076.164879] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1076.201728] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1076.201924] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1076.202094] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1076.202272] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-806" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.202595] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-1d2cd38a-8800-40b7-95da-1e28e3359a3b taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.203774] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-1d2cd38a-8800-40b7-95da-1e28e3359a3b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.203774] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-1d2cd38a-8800-40b7-95da-1e28e3359a3b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.203774] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-1d2cd38a-8800-40b7-95da-1e28e3359a3b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.203774] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d2cd38a-8800-40b7-95da-1e28e3359a3b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.313989] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.317029] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.317029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.317029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.317255] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.317347] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.318029] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.318029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.318029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.318029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.318029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.318029] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee is going to be updated. [ 1076.374934] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.375092] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.375138] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.375353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.375483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.391190] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: IN_PROGRESS for 2s [ 1076.411139] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f in Status: SUCCESS [ 1076.411352] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.411522] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.411738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.411927] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.412056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.412119] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.412263] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.412345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.412442] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ac79ffc-f04a-42fd-81ac-d6a0498a399f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.565461] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.566746] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.708101] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.708101] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.708101] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.708101] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.708101] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.708101] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 1d2cd38a-8800-40b7-95da-1e28e3359a3b not found, creating... [ 1076.708101] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.708101] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.708101] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.708101] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.708101] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.708817] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.709526] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.709526] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.709589] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.709787] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.710457] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 1d2cd38a-8800-40b7-95da-1e28e3359a3b is going to be created. [ 1076.734630] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.734966] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.735363] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.735653] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.735963] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.736433] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-1d2cd38a-8800-40b7-95da-1e28e3359a3b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.816575] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.915032] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ac79ffc-f04a-42fd-81ac-d6a0498a399f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.959757] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ce59d72-8fa4-451a-bee1-2baec693136d in Status: SUCCESS [ 1076.959938] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ce59d72-8fa4-451a-bee1-2baec693136d deletion is rescheduled due to dependency. [ 1076.960101] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.068282] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.068963] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.321433] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.321433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.321433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.321433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.321692] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.321692] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1077.361215] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.361434] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.361434] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.361626] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.361773] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.372231] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1077.418784] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ac79ffc-f04a-42fd-81ac-d6a0498a399f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.458544] env[66519]: INFO networking_nsxv3.common.synchronization [req-80fccda2-1751-47df-a8e2-3833bed457c2 req-ca88fd72-b8ce-461a-88c2-a875293168c5 service nova] Enqueued Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_rules [ 1077.458544] env[66519]: INFO networking_nsxv3.common.synchronization [req-80fccda2-1751-47df-a8e2-3833bed457c2 req-ca88fd72-b8ce-461a-88c2-a875293168c5 service nova] Enqueued Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 1077.458544] env[66519]: INFO networking_nsxv3.common.synchronization [req-80fccda2-1751-47df-a8e2-3833bed457c2 req-ca88fd72-b8ce-461a-88c2-a875293168c5 service nova] Enqueued Resource ID: 1d2cd38a-8800-40b7-95da-1e28e3359a3b with Priority: HIGHEST for action port [ 1077.460034] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_rules [ 1077.460105] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 1077.460609] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d2cd38a-8800-40b7-95da-1e28e3359a3b with Priority: HIGHEST for action port [ 1077.460814] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.460976] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.461052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.461265] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.461899] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.462408] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.463449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.463449] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d2cd38a-8800-40b7-95da-1e28e3359a3b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.463449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d2cd38a-8800-40b7-95da-1e28e3359a3b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.463449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d2cd38a-8800-40b7-95da-1e28e3359a3b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.463449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d2cd38a-8800-40b7-95da-1e28e3359a3b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.463449] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d2cd38a-8800-40b7-95da-1e28e3359a3b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.572483] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.572792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.572792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.572950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.572992] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.573105] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 is going to be updated. [ 1077.574447] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.574542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.574590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.575133] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.575133] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.575615] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be updated. [ 1077.625838] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.625838] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.626053] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.626158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.626445] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.629066] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.630013] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.630013] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.630013] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.630013] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.642497] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: IN_PROGRESS for 2s [ 1077.643895] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 in Status: IN_PROGRESS for 2s [ 1077.921211] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.921589] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.921589] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.921589] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.921759] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.921759] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f is going to be updated. [ 1077.957671] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.957835] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.957914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.958147] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.958328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.965163] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.965298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.965512] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d2cd38a-8800-40b7-95da-1e28e3359a3b with status ACTIVE [ 1077.965692] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.965802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.965866] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.966078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.966168] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.966385] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.966455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.966512] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.966693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.966772] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.966987] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.967107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.967169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.967322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.967461] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.967506] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d2cd38a-8800-40b7-95da-1e28e3359a3b is going to be updated. [ 1077.969194] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f in Status: IN_PROGRESS for 2s [ 1077.990876] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.990986] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.991102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.991318] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.991453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.991616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d2cd38a-8800-40b7-95da-1e28e3359a3b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.084863] env[66519]: INFO networking_nsxv3.common.synchronization [None req-e6b157c2-8a33-4ebe-9789-ae63d7e6ffad tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_rules [ 1078.085457] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_rules [ 1078.085756] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07045da6-f782-414e-a106-61339a5520a8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.085872] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.085940] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.086400] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.086522] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.290558] env[66519]: INFO networking_nsxv3.common.synchronization [None req-3cd31ce0-0bae-4d50-a8b9-55daac660c08 tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_rules [ 1078.290558] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_rules [ 1078.292700] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07045da6-f782-414e-a106-61339a5520a8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.292840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.401571] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: SUCCESS [ 1078.401769] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee deletion is rescheduled due to dependency. [ 1078.401890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.402076] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.402301] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.402491] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.402608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.402675] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.402832] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.402914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.403021] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.613150] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.613294] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.613366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.613587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.613695] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.613811] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07045da6-f782-414e-a106-61339a5520a8 already deleted. [ 1078.613900] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.616793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.616961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.617068] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.904845] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.143070] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.143070] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.143070] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.143446] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.143446] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.143446] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07045da6-f782-414e-a106-61339a5520a8 already deleted. [ 1079.143446] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.382741] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1079.383057] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.383230] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.383453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.383663] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.383839] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.383959] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.384091] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.384171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.384258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.384352] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.407286] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.653959] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 in Status: SUCCESS [ 1079.654247] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.654411] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.654629] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.654821] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.654934] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.655021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.655165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.655233] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.655328] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.656764] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: SUCCESS [ 1079.657049] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.657100] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.657249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.657430] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.657535] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.657596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.657737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.657834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.657915] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.887667] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.887979] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.887979] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.888163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.888333] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.888524] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.888610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.888730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.888810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.889744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.889744] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.889744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.889744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.889744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.889744] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.890335] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.890335] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.890516] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.890744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.890933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.891146] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.910164] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.910372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.910452] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.910684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.910761] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.910859] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee is going to be updated. [ 1079.945711] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.945889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.946161] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.946315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.946447] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.957362] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: IN_PROGRESS for 2s [ 1079.979971] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f in Status: SUCCESS [ 1079.980293] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.980576] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.980846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.981127] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.981410] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.981410] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.981554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.981617] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.981752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.981884] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ac79ffc-f04a-42fd-81ac-d6a0498a399f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.100789] env[66519]: INFO networking_nsxv3.common.synchronization [req-6895576c-4f0e-414a-a14d-b46d6921eed9 req-1594434d-2684-4a85-b750-709622169181 tempest-ServersAdminTestJSON-863383517 tempest-ServersAdminTestJSON-863383517-project-member] Enqueued Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 1080.102623] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 1080.102623] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.102623] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.102623] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.102623] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.102623] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.102938] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.102938] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.103044] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.103273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.103273] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.159351] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.160396] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.394554] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 811de0c5-86ee-4ef7-afc3-0946a87f0b2e: rpc.has_security_group_logging(os_id): False [ 1080.412901] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.413108] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.413182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.413400] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.413615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.414018] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.414423] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.414542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.414685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.414772] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.414967] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.415083] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.415147] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.415307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.415382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.416145] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.416145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.416145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.416145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.416145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.416145] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1080.484373] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.484520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.484593] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.484810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.484996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.486089] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ac79ffc-f04a-42fd-81ac-d6a0498a399f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.502632] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1080.605269] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.662473] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.663442] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.988371] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ac79ffc-f04a-42fd-81ac-d6a0498a399f: rpc.has_security_group_logging(os_id): False [ 1081.007554] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.007721] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.007758] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.007968] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.008078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.008310] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.008459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.008572] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.010125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.010125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.010125] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f is going to be created. [ 1081.060545] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.060617] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.060668] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.060891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.061107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.075779] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f in Status: IN_PROGRESS for 2s [ 1081.110410] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.164703] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.165026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.165026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.165185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.165328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.165368] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 is going to be updated. [ 1081.167049] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.167269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.167377] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.167641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.167729] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.167830] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be updated. [ 1081.235185] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.235361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.235361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.235585] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.236267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.237742] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.237854] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.237906] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.238140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.238301] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.252718] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: IN_PROGRESS for 2s [ 1081.253448] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 in Status: IN_PROGRESS for 2s [ 1081.613370] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.613545] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.613628] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.614015] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.614015] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.614239] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 is going to be updated. [ 1081.670464] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.670667] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.670667] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.670909] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.671069] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.684426] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: IN_PROGRESS for 2s [ 1081.967871] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: SUCCESS [ 1081.968148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.968401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.968657] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.968859] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.968973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.969051] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.969208] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.969292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.969377] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.969470] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.472190] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.523126] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1082.523362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.975133] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7af6979-b772-40ee-bdb9-b29ca300beee: rpc.has_security_group_logging(os_id): False [ 1082.995439] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.995584] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.995657] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.995874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.995965] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.999463] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.999463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.999463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.999463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.999463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.999463] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee is going to be updated. [ 1083.068019] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.068262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.068385] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.068787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.068951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.087624] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: IN_PROGRESS for 2s [ 1083.089965] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f in Status: SUCCESS [ 1083.090303] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.263481] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: SUCCESS [ 1083.263568] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.263774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.263931] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.264129] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.264245] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.264312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.264467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.264599] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.264636] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.266171] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 in Status: SUCCESS [ 1083.266387] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.267030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.267030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.267145] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.267194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.268126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.268126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.268126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.268126] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.695779] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: SUCCESS [ 1083.696125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.770626] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.771998] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.273732] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.274981] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.776512] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.776789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.776789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.777061] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.777185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.777289] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be updated. [ 1084.778751] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.778910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.778973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.779136] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.779258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.779368] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 is going to be updated. [ 1084.819036] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.819133] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.819207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.819438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.819595] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.821392] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.821516] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.821585] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.821760] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.821889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.833567] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: IN_PROGRESS for 2s [ 1084.834365] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 in Status: IN_PROGRESS for 2s [ 1084.937165] env[66519]: INFO networking_nsxv3.common.synchronization [req-88adc94d-87af-432c-9cc5-acaa613e35c6 req-7ca5a654-59d1-47c8-b5b5-5e9cf2f546ed tempest-AttachVolumeNegativeTest-1001897465 tempest-AttachVolumeNegativeTest-1001897465-project-member] Enqueued Resource ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa with Priority: HIGHEST for action security_group_members [ 1084.938055] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa with Priority: HIGHEST for action security_group_members [ 1084.938233] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.938437] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.938553] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.938864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.939082] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.939219] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.939469] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.939551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.939693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.939850] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4090bc61-1cc1-4db7-9c78-0f0fabacd9aa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.103152] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: SUCCESS [ 1085.103586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.272847] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-322 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.274024] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-322" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.274024] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-322" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.274024] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-322" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.274024] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.274209] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.274209] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.274438] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.274588] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.274794] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.274900] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1085.275011] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1085.275121] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1085.275336] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1085.275336] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1085.276386] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1085.297719] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1085.297890] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1085.298053] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1085.298248] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-322" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.298603] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-fdf727a2-e8fc-4d11-bc17-aa4b62a6ac42 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.298782] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-fdf727a2-e8fc-4d11-bc17-aa4b62a6ac42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.299051] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-fdf727a2-e8fc-4d11-bc17-aa4b62a6ac42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.299562] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-fdf727a2-e8fc-4d11-bc17-aa4b62a6ac42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.299726] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdf727a2-e8fc-4d11-bc17-aa4b62a6ac42',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.441978] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.442276] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.442359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.442580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.442670] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.442923] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.443099] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.443202] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.443435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.443559] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.443697] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa already deleted. [ 1085.443840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.802891] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.803213] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.803256] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.803538] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.803675] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.803823] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port fdf727a2-e8fc-4d11-bc17-aa4b62a6ac42 not found, creating... [ 1085.804094] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.804244] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.804357] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.805249] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.805249] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.805249] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.805249] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.805249] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.805517] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.805555] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.805691] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: fdf727a2-e8fc-4d11-bc17-aa4b62a6ac42 is going to be created. [ 1085.827128] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.827345] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.827524] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.827748] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.828073] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.828341] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-fdf727a2-e8fc-4d11-bc17-aa4b62a6ac42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.536059] env[66519]: INFO networking_nsxv3.common.synchronization [req-88adc94d-87af-432c-9cc5-acaa613e35c6 req-e99d978e-4770-481c-a57c-dc56e2dce2b8 service nova] Enqueued Resource ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa with Priority: HIGHEST for action security_group_rules [ 1086.536254] env[66519]: INFO networking_nsxv3.common.synchronization [req-88adc94d-87af-432c-9cc5-acaa613e35c6 req-e99d978e-4770-481c-a57c-dc56e2dce2b8 service nova] Enqueued Resource ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa with Priority: HIGHEST for action security_group_members [ 1086.536404] env[66519]: INFO networking_nsxv3.common.synchronization [req-88adc94d-87af-432c-9cc5-acaa613e35c6 req-e99d978e-4770-481c-a57c-dc56e2dce2b8 service nova] Enqueued Resource ID: fdf727a2-e8fc-4d11-bc17-aa4b62a6ac42 with Priority: HIGHEST for action port [ 1086.536706] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa with Priority: HIGHEST for action security_group_rules [ 1086.536837] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa with Priority: HIGHEST for action security_group_members [ 1086.536938] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf727a2-e8fc-4d11-bc17-aa4b62a6ac42 with Priority: HIGHEST for action port [ 1086.537488] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.541018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.541018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.541213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.541434] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4090bc61-1cc1-4db7-9c78-0f0fabacd9aa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.542270] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.542386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.542530] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.542628] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.542776] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.542870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.542933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.543093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.543176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.543270] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4090bc61-1cc1-4db7-9c78-0f0fabacd9aa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.544072] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdf727a2-e8fc-4d11-bc17-aa4b62a6ac42 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.544173] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdf727a2-e8fc-4d11-bc17-aa4b62a6ac42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.544239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdf727a2-e8fc-4d11-bc17-aa4b62a6ac42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.544439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdf727a2-e8fc-4d11-bc17-aa4b62a6ac42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.544495] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdf727a2-e8fc-4d11-bc17-aa4b62a6ac42',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.847454] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: SUCCESS [ 1086.847759] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.847943] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.848232] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.848462] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.848628] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.848719] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.848907] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.849018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.849153] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.849247] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.850723] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 in Status: SUCCESS [ 1086.850920] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.851084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.851258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.851459] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.851533] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.851667] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.851852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.851899] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.851942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.852040] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.046778] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4090bc61-1cc1-4db7-9c78-0f0fabacd9aa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.047817] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.047933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.048143] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fdf727a2-e8fc-4d11-bc17-aa4b62a6ac42 with status ACTIVE [ 1087.048324] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.048448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.048597] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.048842] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.048987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.049179] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.049282] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.049346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.049513] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.049596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.049819] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.049893] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.049982] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.050151] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.050227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.050313] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fdf727a2-e8fc-4d11-bc17-aa4b62a6ac42 is going to be updated. [ 1087.076666] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.076809] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.076885] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.077197] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.077331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.077499] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdf727a2-e8fc-4d11-bc17-aa4b62a6ac42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.251700] env[66519]: INFO networking_nsxv3.common.synchronization [req-cbfa7702-5729-479e-ac5e-8cebee8f2ff2 req-8ce5e422-2411-4c4d-b29f-c829ad80f9c7 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1087.252037] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1087.252348] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.252520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.252601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.252854] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.253090] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.253258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.253360] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.253591] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.253741] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.253860] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.354395] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.354395] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.354635] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.552686] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4090bc61-1cc1-4db7-9c78-0f0fabacd9aa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.561393] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.562177] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-582" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.562177] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-582" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.562177] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-582" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.562655] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.562655] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.562793] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.563045] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.563256] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.563490] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1087.563618] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1087.563779] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1087.563920] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1087.564073] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1087.564397] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1087.564397] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1087.589102] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1087.589401] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1087.589569] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1087.589779] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-582" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.590162] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.590367] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.590494] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.590859] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.591049] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e2d17b2-efd0-47a6-ac6d-46fed5009f39',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.756823] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.857669] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a51e17dc-f2f0-443a-9853-7cd6fa24da87: rpc.has_security_group_logging(os_id): False [ 1087.875758] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.875936] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.875972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.876190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.876281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.876513] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.876615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.876690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.876846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.876917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.877013] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 is going to be created. [ 1087.927338] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.927473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.927564] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.927757] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.927933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.940671] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 in Status: IN_PROGRESS for 2s [ 1088.055557] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.055715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.055821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.055987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.056088] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.056241] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa is going to be created. [ 1088.082992] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.083183] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.083222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.083468] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.083605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.093975] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa in Status: UNINITIALIZED for 2s [ 1088.094540] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.094819] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.095041] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.095436] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.095681] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.095926] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 9e2d17b2-efd0-47a6-ac6d-46fed5009f39 not found, creating... [ 1088.096369] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.096630] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.096836] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.097209] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.097444] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.097896] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.098166] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.098375] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.098714] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.099436] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.099436] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 9e2d17b2-efd0-47a6-ac6d-46fed5009f39 is going to be created. [ 1088.122458] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.122713] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.122837] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.123129] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.123351] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.123587] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.260165] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.763158] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.763158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.763158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.763158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.763851] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.763851] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be updated. [ 1088.796526] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.796727] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.796831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.797154] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.797359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.809615] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: IN_PROGRESS for 2s [ 1088.843022] env[66519]: INFO networking_nsxv3.common.synchronization [req-cbfa7702-5729-479e-ac5e-8cebee8f2ff2 req-2e52af9c-73d9-4627-a43c-089df1b2d165 service nova] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_rules [ 1088.843255] env[66519]: INFO networking_nsxv3.common.synchronization [req-cbfa7702-5729-479e-ac5e-8cebee8f2ff2 req-2e52af9c-73d9-4627-a43c-089df1b2d165 service nova] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1088.843457] env[66519]: INFO networking_nsxv3.common.synchronization [req-cbfa7702-5729-479e-ac5e-8cebee8f2ff2 req-2e52af9c-73d9-4627-a43c-089df1b2d165 service nova] Enqueued Resource ID: 9e2d17b2-efd0-47a6-ac6d-46fed5009f39 with Priority: HIGHEST for action port [ 1088.845247] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_rules [ 1088.845408] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1088.845512] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e2d17b2-efd0-47a6-ac6d-46fed5009f39 with Priority: HIGHEST for action port [ 1088.845821] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.845921] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.846148] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.846235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.846457] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.846583] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.846651] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.846867] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.846949] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e2d17b2-efd0-47a6-ac6d-46fed5009f39',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.349541] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e2d17b2-efd0-47a6-ac6d-46fed5009f39 with status ACTIVE [ 1089.349864] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.349962] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.350047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.350268] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.350358] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.350544] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.350638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.350698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.350875] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.350978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.351200] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.351299] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.351362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.351577] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.351577] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.351656] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e2d17b2-efd0-47a6-ac6d-46fed5009f39 is going to be updated. [ 1089.373087] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.373425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.373425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.373560] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.373951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.373951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.644147] env[66519]: INFO networking_nsxv3.common.synchronization [req-fd420d3e-10da-4310-8a8d-baf21c9f7c52 req-513dd07d-5d8a-48d8-b040-3e73e2f20daf tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_members [ 1089.647125] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_members [ 1089.647471] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-07045da6-f782-414e-a106-61339a5520a8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.647595] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.647666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.647906] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.648079] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.648185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.648250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.648401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.648504] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.648672] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.954635] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 in Status: SUCCESS [ 1089.954884] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.955091] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.955320] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.955890] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.972208] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.972414] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.972537] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.972856] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.973142] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.973301] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.973415] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.973639] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.973779] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.973987] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.974110] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.974215] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.974317] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.974423] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.974525] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.974656] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1090.003087] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1090.003274] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1090.003416] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1090.003584] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.003901] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-3e3703fe-5b2b-48f9-86a3-1d8af03afca5 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.004094] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-3e3703fe-5b2b-48f9-86a3-1d8af03afca5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.004209] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-3e3703fe-5b2b-48f9-86a3-1d8af03afca5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.004550] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-3e3703fe-5b2b-48f9-86a3-1d8af03afca5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.004687] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e3703fe-5b2b-48f9-86a3-1d8af03afca5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.121140] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa in Status: SUCCESS [ 1090.121486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.121783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.122243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.122570] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.122776] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.122884] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.123193] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.123350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.123622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.123755] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4090bc61-1cc1-4db7-9c78-0f0fabacd9aa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.150522] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.150888] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.150888] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.151160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.151303] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.151570] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.151703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.151794] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.151989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.152110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.152208] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07045da6-f782-414e-a106-61339a5520a8 already deleted. [ 1090.152306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.457985] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a51e17dc-f2f0-443a-9853-7cd6fa24da87 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.458448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.458448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.458860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.459170] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.459333] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.459419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.459661] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.459775] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.459896] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.459992] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.507660] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.507953] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.508054] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.508306] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.508454] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.508752] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 3e3703fe-5b2b-48f9-86a3-1d8af03afca5 not found, creating... [ 1090.509040] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.509226] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.509317] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.509564] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.509728] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.510029] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.510188] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.510303] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.510518] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.510648] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.510786] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 3e3703fe-5b2b-48f9-86a3-1d8af03afca5 is going to be created. [ 1090.532202] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.532416] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.532559] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.532814] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.533064] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.533298] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-3e3703fe-5b2b-48f9-86a3-1d8af03afca5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.627470] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4090bc61-1cc1-4db7-9c78-0f0fabacd9aa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.821903] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: SUCCESS [ 1090.821903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.821903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.821903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.821903] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.821903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.821903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.821903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.821903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.821903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.821903] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.821903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.821903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.822551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.822551] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.822647] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.822738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.822912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.823812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.823812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.823812] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.824307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.824425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.824599] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.824773] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.824823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.824967] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.825075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.825181] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.962787] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.129332] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa: rpc.has_security_group_logging(os_id): False [ 1091.151341] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.151509] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.151574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.151807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.151897] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.152198] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.152331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.153025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.153025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.153025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.153025] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa is going to be created. [ 1091.230751] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.230950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.231073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.231298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.231529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.249114] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa in Status: IN_PROGRESS for 2s [ 1091.265139] env[66519]: INFO networking_nsxv3.common.synchronization [req-fd420d3e-10da-4310-8a8d-baf21c9f7c52 req-18601439-db30-4f0d-9457-2ff3b6f850ed service nova] Enqueued Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_rules [ 1091.265442] env[66519]: INFO networking_nsxv3.common.synchronization [req-fd420d3e-10da-4310-8a8d-baf21c9f7c52 req-18601439-db30-4f0d-9457-2ff3b6f850ed service nova] Enqueued Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_members [ 1091.265499] env[66519]: INFO networking_nsxv3.common.synchronization [req-fd420d3e-10da-4310-8a8d-baf21c9f7c52 req-18601439-db30-4f0d-9457-2ff3b6f850ed service nova] Enqueued Resource ID: 3e3703fe-5b2b-48f9-86a3-1d8af03afca5 with Priority: HIGHEST for action port [ 1091.266061] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_rules [ 1091.266231] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_members [ 1091.266282] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e3703fe-5b2b-48f9-86a3-1d8af03afca5 with Priority: HIGHEST for action port [ 1091.266582] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07045da6-f782-414e-a106-61339a5520a8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.266700] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.266767] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.267014] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.267176] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.268146] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-07045da6-f782-414e-a106-61339a5520a8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.268254] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.268344] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.268628] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.268766] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.268901] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.268990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.269078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.269172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.269267] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.270184] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e3703fe-5b2b-48f9-86a3-1d8af03afca5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.270293] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e3703fe-5b2b-48f9-86a3-1d8af03afca5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.270390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e3703fe-5b2b-48f9-86a3-1d8af03afca5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.270704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e3703fe-5b2b-48f9-86a3-1d8af03afca5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.270704] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e3703fe-5b2b-48f9-86a3-1d8af03afca5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.327226] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4947ab6-b221-4af2-81e1-008fe8a07c25: rpc.has_security_group_logging(os_id): False [ 1091.329018] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.357770] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.358026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.358026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.359039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.359039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.359039] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.359039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.359039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.359415] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.359415] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.359495] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.359578] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.359693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.359799] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.359871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.360094] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.360186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.360364] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.360425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.360478] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.360626] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be updated. [ 1091.465020] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a51e17dc-f2f0-443a-9853-7cd6fa24da87: rpc.has_security_group_logging(os_id): False [ 1091.467705] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.467893] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.467956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.468165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.468401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.485950] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: IN_PROGRESS for 2s [ 1091.499027] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.499230] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.499295] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.499471] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.499560] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.499792] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.499892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.499967] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.500141] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.500218] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.500307] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 is going to be updated. [ 1091.615210] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.615383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.615423] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.615653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.615802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.646510] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 in Status: IN_PROGRESS for 2s [ 1091.773277] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-07045da6-f782-414e-a106-61339a5520a8 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.773277] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.773482] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.774869] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e3703fe-5b2b-48f9-86a3-1d8af03afca5 with status ACTIVE [ 1091.774869] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.774869] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.775094] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.775170] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.775275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.775471] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.775599] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.775661] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.779340] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.779340] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.779340] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.779340] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.779340] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.779340] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.779340] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.779340] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e3703fe-5b2b-48f9-86a3-1d8af03afca5 is going to be updated. [ 1091.805255] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.805442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.805523] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.805752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.805890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.806091] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e3703fe-5b2b-48f9-86a3-1d8af03afca5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.831927] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.280602] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.334530] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.334697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.334747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.334978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.335144] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.335242] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be updated. [ 1092.372030] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.372030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.372030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.372030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.372030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.382438] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: IN_PROGRESS for 2s [ 1092.783407] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.783752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.783752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.783841] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.784275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.784275] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07045da6-f782-414e-a106-61339a5520a8 is going to be created. [ 1092.811439] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.811645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.811645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.811990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.812259] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.823546] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07045da6-f782-414e-a106-61339a5520a8 in Status: UNINITIALIZED for 2s [ 1093.264260] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa in Status: SUCCESS [ 1093.264465] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.501183] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: SUCCESS [ 1093.501406] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.501586] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.501819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.501903] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.660112] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 in Status: SUCCESS [ 1093.660367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.878901] env[66519]: INFO networking_nsxv3.common.synchronization [req-68e0ce3b-3934-4670-bbe9-3c9d2818e59a req-23618d0f-e403-43b8-878a-85e220a8a0e3 tempest-ServersTestJSON-971253557 tempest-ServersTestJSON-971253557-project-member] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1093.879579] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1093.879931] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.880075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.880143] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.880359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.880508] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.880623] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.880701] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.880864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.880947] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.881058] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.005300] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.005300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.254033] env[66519]: INFO networking_nsxv3.common.synchronization [req-7255f4aa-bc0d-4172-81b2-85cb95c2bf0d req-15adb7a3-abeb-43f6-b377-7857701dbecd tempest-ServersAdminTestJSON-863383517 tempest-ServersAdminTestJSON-863383517-project-member] Enqueued Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 1094.254628] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 1094.254927] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.255116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.255228] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.255460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.255667] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.255817] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.255928] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.256155] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.256304] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.256408] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.316277] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-450 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.316572] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.316752] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.317064] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.317781] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.317781] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.317781] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.317974] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.318777] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.318777] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.318777] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1094.318777] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1094.318942] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1094.318942] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.319067] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1094.319257] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1094.339026] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1094.339026] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1094.339236] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1094.339358] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-450" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.339701] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-8926a9da-59c3-4d6e-9023-fae2ec6048b0 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.339898] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-8926a9da-59c3-4d6e-9023-fae2ec6048b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.340045] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-8926a9da-59c3-4d6e-9023-fae2ec6048b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.340406] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-8926a9da-59c3-4d6e-9023-fae2ec6048b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.340539] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8926a9da-59c3-4d6e-9023-fae2ec6048b0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.384445] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.396700] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: SUCCESS [ 1094.396930] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.397121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.397371] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.397817] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.397961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.398062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.398233] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.398320] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.398411] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.398503] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.759098] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.834033] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07045da6-f782-414e-a106-61339a5520a8 in Status: SUCCESS [ 1094.834033] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.834259] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.834417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.834634] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.834759] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.834824] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.834994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.835092] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.835176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.835269] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.843057] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.843333] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.843477] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.843894] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.843929] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.844242] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 8926a9da-59c3-4d6e-9023-fae2ec6048b0 not found, creating... [ 1094.844536] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.844699] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.844817] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.845058] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.845261] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.845600] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.845768] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.845911] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.846165] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.846311] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.846460] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 8926a9da-59c3-4d6e-9023-fae2ec6048b0 is going to be created. [ 1094.871750] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.871750] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.871750] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.872189] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.872272] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.872546] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-8926a9da-59c3-4d6e-9023-fae2ec6048b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.887804] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.903214] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.903385] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.903458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.904035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.904035] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.904035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.904253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.904253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.904369] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.904472] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.904621] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.904714] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.904768] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.904923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.905086] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.905498] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.905498] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.905498] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.905498] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.905498] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.905701] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.261995] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.337465] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.390137] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.390272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.390306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.390577] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.390724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.390858] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 1095.411049] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4947ab6-b221-4af2-81e1-008fe8a07c25: rpc.has_security_group_logging(os_id): False [ 1095.428336] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.428336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.428336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.428336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.428336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.432085] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.432879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.432879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.432879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.432879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.432879] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.433224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.433224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.433224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.433355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.433440] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.433854] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.433854] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.433854] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.433854] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.434097] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.434097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.434181] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.434605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.434605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.434605] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be updated. [ 1095.439795] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 1095.508046] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.508046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.508046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.508046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.508046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.538095] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: IN_PROGRESS for 2s [ 1095.609173] env[66519]: INFO networking_nsxv3.common.synchronization [req-68e0ce3b-3934-4670-bbe9-3c9d2818e59a req-d4345d6a-a947-405c-9189-65d9be1b9bee service nova] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_rules [ 1095.609306] env[66519]: INFO networking_nsxv3.common.synchronization [req-68e0ce3b-3934-4670-bbe9-3c9d2818e59a req-d4345d6a-a947-405c-9189-65d9be1b9bee service nova] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1095.609431] env[66519]: INFO networking_nsxv3.common.synchronization [req-68e0ce3b-3934-4670-bbe9-3c9d2818e59a req-d4345d6a-a947-405c-9189-65d9be1b9bee service nova] Enqueued Resource ID: 8926a9da-59c3-4d6e-9023-fae2ec6048b0 with Priority: HIGHEST for action port [ 1095.610091] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_rules [ 1095.610261] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1095.610345] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8926a9da-59c3-4d6e-9023-fae2ec6048b0 with Priority: HIGHEST for action port [ 1095.611055] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.611194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.611269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.611477] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.611797] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.614749] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.614749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.614749] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-8926a9da-59c3-4d6e-9023-fae2ec6048b0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.614749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8926a9da-59c3-4d6e-9023-fae2ec6048b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.614749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8926a9da-59c3-4d6e-9023-fae2ec6048b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.614749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8926a9da-59c3-4d6e-9023-fae2ec6048b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.614749] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8926a9da-59c3-4d6e-9023-fae2ec6048b0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.765173] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.765697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.765800] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.766027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.766136] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.766232] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 is going to be updated. [ 1095.801363] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.801603] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.801666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.801924] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.802155] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.813197] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: IN_PROGRESS for 2s [ 1095.839762] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07045da6-f782-414e-a106-61339a5520a8: rpc.has_security_group_logging(os_id): False [ 1095.859334] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.859537] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.859537] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.859808] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.860037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.860365] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.860479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.860546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.860726] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.860827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.860923] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07045da6-f782-414e-a106-61339a5520a8 is going to be created. [ 1095.933270] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.933731] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.933731] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.933731] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.933908] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.946909] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07045da6-f782-414e-a106-61339a5520a8 in Status: IN_PROGRESS for 2s [ 1096.116141] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.116303] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.116530] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8926a9da-59c3-4d6e-9023-fae2ec6048b0 with status ACTIVE [ 1096.116753] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.116850] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.116921] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.117163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.117262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.117911] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.117911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.117911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.118076] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.118187] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.118393] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.118518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.118584] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.118837] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.118933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.119054] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8926a9da-59c3-4d6e-9023-fae2ec6048b0 is going to be updated. [ 1096.143865] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.144106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.144106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.144487] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.144640] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.144831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8926a9da-59c3-4d6e-9023-fae2ec6048b0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.449144] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 1097.449474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.449518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.449785] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.449977] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.450110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.450176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.450324] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.450406] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.450498] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.553139] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: SUCCESS [ 1097.553444] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.553691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.553929] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.554039] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.822724] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: SUCCESS [ 1097.822970] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.952050] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.961284] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07045da6-f782-414e-a106-61339a5520a8 in Status: SUCCESS [ 1097.961678] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.056650] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.056887] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.056887] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.057188] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.057381] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.057529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.057585] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.057965] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.057965] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.057965] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.058159] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.181477] env[66519]: INFO networking_nsxv3.common.synchronization [req-4ee508a6-2252-4c8e-b4c1-b8dba974004d req-02ee79d1-4bb1-406c-8bf5-1b2a150c0826 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1098.181567] env[66519]: INFO networking_nsxv3.common.synchronization [req-4ee508a6-2252-4c8e-b4c1-b8dba974004d req-02ee79d1-4bb1-406c-8bf5-1b2a150c0826 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: 7cdb20c0-2042-4cd0-941c-043033c0364c with Priority: HIGHEST for action security_group_members [ 1098.182124] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1098.182318] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdb20c0-2042-4cd0-941c-043033c0364c with Priority: HIGHEST for action security_group_members [ 1098.182756] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.182933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.183089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.183478] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.183580] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.183680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.183788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.184025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.184198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.184198] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.185250] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdb20c0-2042-4cd0-941c-043033c0364c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.185250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.185475] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.185548] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.185646] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.185738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.185806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.185972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.187050] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.187050] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdb20c0-2042-4cd0-941c-043033c0364c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.239585] env[66519]: INFO networking_nsxv3.common.synchronization [req-4ee508a6-2252-4c8e-b4c1-b8dba974004d req-02ee79d1-4bb1-406c-8bf5-1b2a150c0826 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: 7cdb20c0-2042-4cd0-941c-043033c0364c with Priority: HIGHEST for action security_group_rules [ 1098.239865] env[66519]: INFO networking_nsxv3.common.synchronization [req-4ee508a6-2252-4c8e-b4c1-b8dba974004d req-02ee79d1-4bb1-406c-8bf5-1b2a150c0826 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: 7cdb20c0-2042-4cd0-941c-043033c0364c with Priority: HIGHEST for action security_group_members [ 1098.240085] env[66519]: INFO networking_nsxv3.common.synchronization [req-4ee508a6-2252-4c8e-b4c1-b8dba974004d req-02ee79d1-4bb1-406c-8bf5-1b2a150c0826 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_rules [ 1098.240260] env[66519]: INFO networking_nsxv3.common.synchronization [req-4ee508a6-2252-4c8e-b4c1-b8dba974004d req-02ee79d1-4bb1-406c-8bf5-1b2a150c0826 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1098.240434] env[66519]: INFO networking_nsxv3.common.synchronization [req-4ee508a6-2252-4c8e-b4c1-b8dba974004d req-02ee79d1-4bb1-406c-8bf5-1b2a150c0826 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: 9e2d17b2-efd0-47a6-ac6d-46fed5009f39 with Priority: HIGHEST for action port [ 1098.241231] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdb20c0-2042-4cd0-941c-043033c0364c with Priority: HIGHEST for action security_group_rules [ 1098.241332] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_rules [ 1098.241464] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e2d17b2-efd0-47a6-ac6d-46fed5009f39 with Priority: HIGHEST for action port [ 1098.241611] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdb20c0-2042-4cd0-941c-043033c0364c with Priority: HIGHEST for action security_group_members [ 1098.241744] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1098.242537] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cdb20c0-2042-4cd0-941c-043033c0364c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.242711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.242812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.243190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.243313] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cdb20c0-2042-4cd0-941c-043033c0364c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.244596] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.244712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.244899] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.245043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.245130] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.245368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.245466] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e2d17b2-efd0-47a6-ac6d-46fed5009f39',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.249299] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdb20c0-2042-4cd0-941c-043033c0364c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.249357] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.249864] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.249864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.454336] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.560359] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.560528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.687659] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.688642] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdb20c0-2042-4cd0-941c-043033c0364c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.750559] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e2d17b2-efd0-47a6-ac6d-46fed5009f39 with status ACTIVE [ 1098.750855] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.751449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.751449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.751449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.751449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.751768] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.751768] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.751768] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.752098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.752098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.752292] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.752357] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.752487] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.752732] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.752732] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.752732] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e2d17b2-efd0-47a6-ac6d-46fed5009f39 is going to be updated. [ 1098.754053] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdb20c0-2042-4cd0-941c-043033c0364c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.754192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.780430] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.780430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.780630] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.781253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.781253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.781253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.956953] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.957180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.957299] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.957520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.957627] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.957733] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 1098.999287] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.999600] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.999600] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.999759] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.999853] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.011074] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 1099.190031] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.191134] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdb20c0-2042-4cd0-941c-043033c0364c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.692880] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.693514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.693514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.693514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.693514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.693739] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be updated. [ 1099.694914] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.695039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.695102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.695271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.695355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.695440] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdb20c0-2042-4cd0-941c-043033c0364c is going to be created. [ 1099.721706] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.721965] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.721965] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.722127] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.722292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.727748] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.727918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.727958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.728147] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.728286] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.734576] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdb20c0-2042-4cd0-941c-043033c0364c in Status: UNINITIALIZED for 2s [ 1099.735914] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: IN_PROGRESS for 2s [ 1101.024412] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 1101.025490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.026065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.026237] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.026578] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.026722] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.026812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.027012] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.027183] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.030038] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.030038] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.220504] env[66519]: INFO networking_nsxv3.common.synchronization [req-1591f5e1-c7dc-44ec-b92a-ca1010ee9447 req-fcd029cc-b56b-4606-bf2a-28a6e4d875ca tempest-ServersAdminTestJSON-863383517 tempest-ServersAdminTestJSON-863383517-project-member] Enqueued Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 1101.221170] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 1101.221514] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.221641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.221708] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.221918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.225031] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.225031] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.225031] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.225031] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.225031] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.225031] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.533925] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.534144] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.534231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.534544] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.535070] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.535070] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.535070] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.535273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.535273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.535364] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.535477] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.535574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.535634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.535777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.535915] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.536012] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.536070] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.536208] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.536283] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.536351] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.536438] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.728528] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.747137] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: SUCCESS [ 1101.747326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.747831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.748114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.748327] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.748724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.748831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.749009] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.749096] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.749208] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.751100] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdb20c0-2042-4cd0-941c-043033c0364c in Status: SUCCESS [ 1101.751383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.751540] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.751829] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.751950] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.752155] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.752222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.752365] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.752487] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.752570] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdb20c0-2042-4cd0-941c-043033c0364c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.042074] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb1cadf6-d26e-4714-b83e-0fcbe235e2e5: rpc.has_security_group_logging(os_id): False [ 1102.061305] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.061305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.061305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.061305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.061305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.061305] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.061639] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.061639] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.061639] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.061717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.061897] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.061984] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.062073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.062213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.062285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.062500] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.062597] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.062656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.062813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.062906] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.062993] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 1102.138424] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.138652] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.139275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.139275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.139275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.167034] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 1102.231792] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.255059] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.256538] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdb20c0-2042-4cd0-941c-043033c0364c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.735191] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.735458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.735458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.735731] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.735900] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.736080] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 is going to be updated. [ 1102.757070] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.758126] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdb20c0-2042-4cd0-941c-043033c0364c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.769059] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.769224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.769270] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.769463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.769612] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.779887] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: IN_PROGRESS for 2s [ 1103.260837] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.261458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.261458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.261458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.261458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.261458] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be updated. [ 1103.262828] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.262949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.263021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.263201] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.263285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.263372] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdb20c0-2042-4cd0-941c-043033c0364c is going to be updated. [ 1103.300940] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.301310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.301310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.301453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.301589] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.303762] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.303883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.303978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.304175] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.304317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.316910] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdb20c0-2042-4cd0-941c-043033c0364c in Status: IN_PROGRESS for 2s [ 1103.317506] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: IN_PROGRESS for 2s [ 1103.385031] env[66519]: INFO networking_nsxv3.common.synchronization [req-9b452749-7655-40ae-9b5c-6e14e18162a0 req-1d68f2e2-4a41-4e78-a9a2-c9a1914c7b11 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: 7cdb20c0-2042-4cd0-941c-043033c0364c with Priority: HIGHEST for action security_group_members [ 1103.385031] env[66519]: INFO networking_nsxv3.common.synchronization [req-9b452749-7655-40ae-9b5c-6e14e18162a0 req-1d68f2e2-4a41-4e78-a9a2-c9a1914c7b11 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1103.385031] env[66519]: INFO networking_nsxv3.common.synchronization [req-9b452749-7655-40ae-9b5c-6e14e18162a0 req-1d68f2e2-4a41-4e78-a9a2-c9a1914c7b11 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: 3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba with Priority: HIGHEST for action security_group_members [ 1103.385643] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdb20c0-2042-4cd0-941c-043033c0364c with Priority: HIGHEST for action security_group_members [ 1103.385643] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1103.385643] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba with Priority: HIGHEST for action security_group_members [ 1103.385643] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdb20c0-2042-4cd0-941c-043033c0364c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.385801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.386159] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.386271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.386465] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.386571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.386649] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.386899] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.387067] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.387168] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.387249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.387465] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.387685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.387729] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.433032] env[66519]: INFO networking_nsxv3.common.synchronization [req-9b452749-7655-40ae-9b5c-6e14e18162a0 req-1d68f2e2-4a41-4e78-a9a2-c9a1914c7b11 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: 3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba with Priority: HIGHEST for action security_group_rules [ 1103.433336] env[66519]: INFO networking_nsxv3.common.synchronization [req-9b452749-7655-40ae-9b5c-6e14e18162a0 req-1d68f2e2-4a41-4e78-a9a2-c9a1914c7b11 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: 3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba with Priority: HIGHEST for action security_group_members [ 1103.433550] env[66519]: INFO networking_nsxv3.common.synchronization [req-9b452749-7655-40ae-9b5c-6e14e18162a0 req-1d68f2e2-4a41-4e78-a9a2-c9a1914c7b11 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: 7cdb20c0-2042-4cd0-941c-043033c0364c with Priority: HIGHEST for action security_group_rules [ 1103.433764] env[66519]: INFO networking_nsxv3.common.synchronization [req-9b452749-7655-40ae-9b5c-6e14e18162a0 req-1d68f2e2-4a41-4e78-a9a2-c9a1914c7b11 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: 7cdb20c0-2042-4cd0-941c-043033c0364c with Priority: HIGHEST for action security_group_members [ 1103.433936] env[66519]: INFO networking_nsxv3.common.synchronization [req-9b452749-7655-40ae-9b5c-6e14e18162a0 req-1d68f2e2-4a41-4e78-a9a2-c9a1914c7b11 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_rules [ 1103.434085] env[66519]: INFO networking_nsxv3.common.synchronization [req-9b452749-7655-40ae-9b5c-6e14e18162a0 req-1d68f2e2-4a41-4e78-a9a2-c9a1914c7b11 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1103.434265] env[66519]: INFO networking_nsxv3.common.synchronization [req-9b452749-7655-40ae-9b5c-6e14e18162a0 req-1d68f2e2-4a41-4e78-a9a2-c9a1914c7b11 tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: 9e2d17b2-efd0-47a6-ac6d-46fed5009f39 with Priority: HIGHEST for action port [ 1103.434898] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba with Priority: HIGHEST for action security_group_rules [ 1103.434951] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdb20c0-2042-4cd0-941c-043033c0364c with Priority: HIGHEST for action security_group_rules [ 1103.435072] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1103.435200] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e2d17b2-efd0-47a6-ac6d-46fed5009f39 with Priority: HIGHEST for action port [ 1103.435425] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_rules [ 1103.435489] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba with Priority: HIGHEST for action security_group_members [ 1103.435601] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdb20c0-2042-4cd0-941c-043033c0364c with Priority: HIGHEST for action security_group_members [ 1103.436212] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.436394] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.436514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.436848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.436933] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.437902] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7cdb20c0-2042-4cd0-941c-043033c0364c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.438016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.438216] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.438300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.438472] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.438566] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.438628] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.438832] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.438908] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e2d17b2-efd0-47a6-ac6d-46fed5009f39',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.439685] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.439867] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.440453] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.440453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.440453] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdb20c0-2042-4cd0-941c-043033c0364c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.440935] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.890384] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.941579] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.941754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.941898] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e2d17b2-efd0-47a6-ac6d-46fed5009f39 with status ACTIVE [ 1103.942085] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.942192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.942259] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.942564] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.942610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.942812] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.942928] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.943035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.943220] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.943301] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.943484] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.943577] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.943637] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.943804] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.943883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.943967] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e2d17b2-efd0-47a6-ac6d-46fed5009f39 is going to be updated. [ 1103.969389] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.969558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.969558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.969762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.969948] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.970252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e2d17b2-efd0-47a6-ac6d-46fed5009f39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.183831] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 1104.184105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.392922] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.792059] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: SUCCESS [ 1104.792298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.897023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.897234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.897305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.897519] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.897609] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.897704] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba is going to be created. [ 1104.921123] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.921301] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.921339] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.921544] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.921697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.930516] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba in Status: UNINITIALIZED for 2s [ 1105.331615] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: SUCCESS [ 1105.331857] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.332060] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.332286] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.332485] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.332598] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.332664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.332819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.332945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.333053] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.333152] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.333233] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.333293] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.333430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.333569] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.333661] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.333721] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.333857] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.333933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.334023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.334121] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.335659] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdb20c0-2042-4cd0-941c-043033c0364c in Status: SUCCESS [ 1105.335851] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.336016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.336185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.336352] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.336453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.336518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.336678] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.336766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.336851] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.338387] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.338568] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.338742] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.338846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.338911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.339069] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.339731] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.339731] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.339731] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7cdb20c0-2042-4cd0-941c-043033c0364c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.341604] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.341804] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.342016] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.342148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.342216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.342372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.342452] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.342542] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdb20c0-2042-4cd0-941c-043033c0364c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.842526] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7cdb20c0-2042-4cd0-941c-043033c0364c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.843769] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.844986] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4947ab6-b221-4af2-81e1-008fe8a07c25: rpc.has_security_group_logging(os_id): False [ 1105.847139] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7cdb20c0-2042-4cd0-941c-043033c0364c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.868378] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.871543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.871543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.871543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.871543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.871543] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.871543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.871543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.871543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.871543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.871543] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.871543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.871543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.871543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.871543] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.872201] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.872201] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.872201] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.872201] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.872201] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.872201] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be updated. [ 1105.941121] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.947174] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.947174] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.947174] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.947174] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.960996] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: IN_PROGRESS for 2s [ 1106.125577] env[66519]: INFO networking_nsxv3.common.synchronization [req-55c19d69-800e-48dd-bb4f-bd01cd35b018 req-cd1b9342-cca9-4925-ad3d-df7d3c0094ca tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1106.126317] env[66519]: INFO networking_nsxv3.common.synchronization [req-55c19d69-800e-48dd-bb4f-bd01cd35b018 req-cd1b9342-cca9-4925-ad3d-df7d3c0094ca tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: 3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba with Priority: HIGHEST for action security_group_members [ 1106.126317] env[66519]: INFO networking_nsxv3.common.synchronization [req-55c19d69-800e-48dd-bb4f-bd01cd35b018 req-cd1b9342-cca9-4925-ad3d-df7d3c0094ca tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: 7cdb20c0-2042-4cd0-941c-043033c0364c with Priority: HIGHEST for action security_group_members [ 1106.126711] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1106.126877] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba with Priority: HIGHEST for action security_group_members [ 1106.127011] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdb20c0-2042-4cd0-941c-043033c0364c with Priority: HIGHEST for action security_group_members [ 1106.128229] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.128229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.128229] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.128229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.128467] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-7cdb20c0-2042-4cd0-941c-043033c0364c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.128518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.347740] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7cdb20c0-2042-4cd0-941c-043033c0364c: rpc.has_security_group_logging(os_id): False [ 1106.350316] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.351243] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7cdb20c0-2042-4cd0-941c-043033c0364c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.370299] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.370299] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.370299] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.370637] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.370637] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.370861] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.370998] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.371137] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.371324] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.371417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.371489] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cdb20c0-2042-4cd0-941c-043033c0364c is going to be created. [ 1106.388195] env[66519]: INFO networking_nsxv3.common.synchronization [req-3b9dcbc3-34f6-440a-8087-eec3a17a684d req-b1c2916c-70dd-40ca-9b51-a22fb1d18b9f tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_members [ 1106.388785] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_members [ 1106.389104] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-07045da6-f782-414e-a106-61339a5520a8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.389230] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.389285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.389481] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.389629] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.389747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.389808] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.390168] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.390168] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.390168] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.453946] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.454345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.454411] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.455037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.455037] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.468023] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cdb20c0-2042-4cd0-941c-043033c0364c in Status: IN_PROGRESS for 2s [ 1106.727836] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.727973] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.728130] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.728391] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.728645] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.728853] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.729108] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.729382] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.729559] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.729794] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1106.729932] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1106.730074] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1106.730213] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1106.730350] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1106.730477] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1106.730644] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1106.750169] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1106.750334] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1106.750461] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1106.750639] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.750958] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-6bbae765-eb79-4752-bfee-0350910fa7aa taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.751211] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-6bbae765-eb79-4752-bfee-0350910fa7aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.751295] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-6bbae765-eb79-4752-bfee-0350910fa7aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.751582] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-6bbae765-eb79-4752-bfee-0350910fa7aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.751721] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bbae765-eb79-4752-bfee-0350910fa7aa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.852885] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.853217] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.853217] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.853351] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.853425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.853771] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be updated. [ 1106.854822] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.854940] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.854994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.855171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.855249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.855332] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdb20c0-2042-4cd0-941c-043033c0364c is going to be updated. [ 1106.888608] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.888880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.888987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.889239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.889411] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.891285] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.891403] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.891461] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.891636] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.891768] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.892786] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.907942] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: IN_PROGRESS for 2s [ 1106.908827] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdb20c0-2042-4cd0-941c-043033c0364c in Status: IN_PROGRESS for 2s [ 1106.942957] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba in Status: SUCCESS [ 1106.943281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.943535] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.943850] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.944109] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.944259] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.944339] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.944550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.944644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.944787] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.255103] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.255349] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.255477] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.255758] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.255904] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.256081] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 6bbae765-eb79-4752-bfee-0350910fa7aa not found, creating... [ 1107.256345] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.256512] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.256629] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.256894] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.257045] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.257328] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.257483] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.257598] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.257827] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.257975] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.258127] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 6bbae765-eb79-4752-bfee-0350910fa7aa is going to be created. [ 1107.293340] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.293661] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.293699] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.293983] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.294249] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.294482] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-6bbae765-eb79-4752-bfee-0350910fa7aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.397438] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.447847] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.448064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.448122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.449455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.449455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.449455] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.449455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.449694] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.449871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.449997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.450142] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba is going to be deleted. [ 1107.490527] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.490719] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.490795] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.491032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.491117] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.491372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.491372] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.491569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.491877] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.491990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.492071] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.492239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.492312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.492442] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.900601] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.900941] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.900941] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.901129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.901251] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.901398] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07045da6-f782-414e-a106-61339a5520a8 is going to be updated. [ 1107.936339] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.936339] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.937190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.937190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.937190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.948440] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07045da6-f782-414e-a106-61339a5520a8 in Status: IN_PROGRESS for 2s [ 1107.977297] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: SUCCESS [ 1107.977297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.977297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.977486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.977593] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.994290] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.994459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.994506] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.994716] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.994808] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.995016] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.995122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.995183] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.995345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.995473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.995524] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba already deleted. [ 1107.995579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.995677] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.996831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.997056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.997214] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.997312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.997373] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.997516] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.997592] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.997677] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.028496] env[66519]: INFO networking_nsxv3.common.synchronization [req-3b9dcbc3-34f6-440a-8087-eec3a17a684d req-8328c49b-7cf2-4884-95db-12aa1e455b19 service nova] Enqueued Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_rules [ 1108.028678] env[66519]: INFO networking_nsxv3.common.synchronization [req-3b9dcbc3-34f6-440a-8087-eec3a17a684d req-8328c49b-7cf2-4884-95db-12aa1e455b19 service nova] Enqueued Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_members [ 1108.029420] env[66519]: INFO networking_nsxv3.common.synchronization [req-3b9dcbc3-34f6-440a-8087-eec3a17a684d req-8328c49b-7cf2-4884-95db-12aa1e455b19 service nova] Enqueued Resource ID: 6bbae765-eb79-4752-bfee-0350910fa7aa with Priority: HIGHEST for action port [ 1108.029589] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_rules [ 1108.029801] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_members [ 1108.029862] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bbae765-eb79-4752-bfee-0350910fa7aa with Priority: HIGHEST for action port [ 1108.031028] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07045da6-f782-414e-a106-61339a5520a8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.031028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.031028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.031028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.031028] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.031616] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-07045da6-f782-414e-a106-61339a5520a8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.031727] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.031891] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bbae765-eb79-4752-bfee-0350910fa7aa taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.031985] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bbae765-eb79-4752-bfee-0350910fa7aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.032088] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bbae765-eb79-4752-bfee-0350910fa7aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.032664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bbae765-eb79-4752-bfee-0350910fa7aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.032664] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bbae765-eb79-4752-bfee-0350910fa7aa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.364232] env[66519]: INFO networking_nsxv3.common.synchronization [req-99b85ae3-8352-45a1-b78e-b3c84cdd5540 req-2c2f58e7-a198-4e39-984b-ffc8d0fa47fe tempest-AttachVolumeShelveTestJSON-264753527 tempest-AttachVolumeShelveTestJSON-264753527-project-member] Enqueued Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGHEST for action security_group_members [ 1108.364769] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGHEST for action security_group_members [ 1108.365118] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b4e85b6-ed99-4ac0-9639-f46dc275381b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.365272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.365342] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.365542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.365689] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.365786] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.365847] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.365989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.366097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.366188] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.479491] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7cdb20c0-2042-4cd0-941c-043033c0364c in Status: SUCCESS [ 1108.479491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.479626] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.479955] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.479955] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.480067] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.480150] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7cdb20c0-2042-4cd0-941c-043033c0364c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.498922] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.500257] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.500384] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.500477] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.501553] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.501553] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.501553] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.501553] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.501553] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.501553] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.501553] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.501553] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba already deleted. [ 1108.501553] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.534212] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-07045da6-f782-414e-a106-61339a5520a8 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.534352] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.536721] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bbae765-eb79-4752-bfee-0350910fa7aa with status ACTIVE [ 1108.537088] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.537214] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.537287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.537500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.537585] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.537770] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.537881] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.537941] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.538107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.538183] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.538360] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.538453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.538511] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.538647] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.538717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.538841] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bbae765-eb79-4752-bfee-0350910fa7aa is going to be updated. [ 1108.561067] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.561067] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.561067] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.561067] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.561334] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.561608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bbae765-eb79-4752-bfee-0350910fa7aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.870122] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.870280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.870351] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.870565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.870657] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.870855] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.870951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.871077] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.871200] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.871284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.871361] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b is going to be updated. [ 1108.901027] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.901027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.901027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.901452] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.901452] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.913332] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b in Status: IN_PROGRESS for 2s [ 1108.921539] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: SUCCESS [ 1108.921736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.921989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.922339] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.922627] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.922801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.922907] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.923169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.923296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.923443] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.925570] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdb20c0-2042-4cd0-941c-043033c0364c in Status: SUCCESS [ 1108.925839] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.926076] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.926340] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.926620] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.926864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.926974] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.927274] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.927336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.927443] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdb20c0-2042-4cd0-941c-043033c0364c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.002075] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.002075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.002423] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.002423] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.002481] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.002589] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7cdb20c0-2042-4cd0-941c-043033c0364c is going to be deleted. [ 1109.003569] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba: rpc.has_security_group_logging(os_id): False [ 1109.027789] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.027789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.027789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.027789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.028307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.028307] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.028307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.028307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.028451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.028482] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.028562] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba is going to be created. [ 1109.054569] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba], does not exist path=[/infra/domains/default/groups/3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba]."\n}' [ 1109.054833] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba [ 1109.055016] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1109.079412] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.079587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.079682] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.080017] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.080158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.080319] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.105041] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.105041] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.105258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.105258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.106489] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.107207] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.107207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.107207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.107207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.107421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.107455] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.107555] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.107739] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.107784] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.107817] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.107910] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba is going to be created. [ 1109.133984] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba], does not exist path=[/infra/domains/default/groups/3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba [ 1109.133984] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.134469] env[66519]: Traceback (most recent call last): [ 1109.134469] env[66519]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1109.134469] env[66519]: return func(*args, **kwargs) [ 1109.134469] env[66519]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1109.134469] env[66519]: res.raise_for_status() [ 1109.134469] env[66519]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1109.134469] env[66519]: raise HTTPError(http_error_msg, response=self) [ 1109.134469] env[66519]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba [ 1109.134469] env[66519]: During handling of the above exception, another exception occurred: [ 1109.134469] env[66519]: Traceback (most recent call last): [ 1109.134469] env[66519]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1109.134469] env[66519]: listener.cb(fileno) [ 1109.134469] env[66519]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1109.134469] env[66519]: result = function(*args, **kwargs) [ 1109.134469] env[66519]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1109.134469] env[66519]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1109.134469] env[66519]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1109.134469] env[66519]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1109.134469] env[66519]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1109.134469] env[66519]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1109.134469] env[66519]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1109.134469] env[66519]: res.raise_for_status() [ 1109.134469] env[66519]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1109.134469] env[66519]: raise HTTPError(http_error_msg, response=self) [ 1109.134469] env[66519]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3cdc24b1-f6c3-436b-b8fc-cb08c88fd0ba [ 1109.134469] env[66519]: Removing descriptor: 58 [ 1109.429348] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.430623] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.430623] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.430775] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.430878] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.450076] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Unable to find Resource=/policy/api/v1/infra/domains/default/security-policies/7cdb20c0-2042-4cd0-941c-043033c0364c/rules [ 1109.450253] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function GET Argumetns {'path': '/policy/api/v1/infra/domains/default/security-policies/7cdb20c0-2042-4cd0-941c-043033c0364c/rules', 'params': {'page_size': 200, 'cursor': ''}} Response=Error Code=400 Message=b'{\n "httpStatus" : "BAD_REQUEST",\n "error_code" : 500012,\n "module_name" : "Policy",\n "error_message" : "The path=[/infra/domains/default/security-policies/7cdb20c0-2042-4cd0-941c-043033c0364c] is invalid"\n}' {{(pid=66519) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:93}} [ 1109.450328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.450563] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.450682] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.450749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.451402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.451402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.451402] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdb20c0-2042-4cd0-941c-043033c0364c is going to be updated. [ 1109.483535] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.483709] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.483790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.484016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.484171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.494492] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdb20c0-2042-4cd0-941c-043033c0364c in Status: IN_PROGRESS for 2s [ 1109.932866] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.958539] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07045da6-f782-414e-a106-61339a5520a8 in Status: SUCCESS [ 1109.958837] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.959544] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.959616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.959834] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.960031] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.960112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.960256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.960344] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.960444] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.347883] env[66519]: INFO networking_nsxv3.common.synchronization [req-0c56a358-3d3c-403c-b588-fbeca0f81a20 req-321ff4cf-9ed1-4811-b499-617e211e2e6b tempest-ServersAdminTestJSON-863383517 tempest-ServersAdminTestJSON-863383517-project-member] Enqueued Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 1110.348503] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGHEST for action security_group_members [ 1110.349129] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.349129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.349129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.349303] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.350224] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.350224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.350224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.350224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.350472] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.350472] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.389246] env[66519]: INFO networking_nsxv3.common.synchronization [req-04ceec6d-2358-4bdd-b0a1-e38b2f35585c req-e4873256-64e6-492d-abda-4a6628fe97aa tempest-ServersTestJSON-971253557 tempest-ServersTestJSON-971253557-project-member] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1110.389755] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1110.390072] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.390205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.390273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.390632] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.390632] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.390788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.390788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.390917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.391018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.391153] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.435451] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.435611] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.435674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.435931] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.436042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.436089] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be updated. [ 1110.463761] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.469355] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.469512] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.469567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.469781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.469925] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.480398] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: IN_PROGRESS for 2s [ 1110.670638] env[66519]: INFO networking_nsxv3.common.synchronization [req-f9baaae2-b1fc-4485-84b5-5ad06ec4aadc req-2541c131-2330-4cd9-bc73-a63a3fb3d1c3 tempest-DeleteServersTestJSON-1278201394 tempest-DeleteServersTestJSON-1278201394-project-member] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1110.671788] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1110.671788] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.671788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.671788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.672013] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.672013] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.672246] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.672246] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.672345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.672441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.672481] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.854060] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.854060] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.854060] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.854060] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.874020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.874313] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.874431] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.874499] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.874706] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.874790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.874877] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 is going to be updated. [ 1110.893529] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.899126] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.899331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.899384] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.899619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.899802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.911976] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: IN_PROGRESS for 2s [ 1110.921068] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b in Status: SUCCESS [ 1110.921068] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b deletion is rescheduled due to dependency. [ 1110.921068] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.967110] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.174785] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.174985] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.174985] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.175266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.198703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.199893] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.199893] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.199893] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.199893] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.199893] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.199893] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1111.249190] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.249451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.249640] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.250033] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.250229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.261472] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1111.396451] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.469733] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.469844] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.469998] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.470276] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.470491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.470566] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07045da6-f782-414e-a106-61339a5520a8 is going to be updated. [ 1111.499909] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.500089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.500156] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.500382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.500538] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.507389] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdb20c0-2042-4cd0-941c-043033c0364c in Status: SUCCESS [ 1111.507573] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdb20c0-2042-4cd0-941c-043033c0364c deletion is rescheduled due to dependency. [ 1111.507687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.507845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.508066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.508249] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.508361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.508426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.508573] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.508669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.508739] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7cdb20c0-2042-4cd0-941c-043033c0364c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.510344] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07045da6-f782-414e-a106-61339a5520a8 in Status: IN_PROGRESS for 2s [ 1111.645230] env[66519]: INFO networking_nsxv3.common.synchronization [req-3e9b09c8-fb16-4c04-9a34-a3eb9fff604b req-d1600d6c-536d-4bb2-81e6-1487cbfc3bd0 tempest-ServerActionsTestOtherA-1261634680 tempest-ServerActionsTestOtherA-1261634680-project-member] Enqueued Resource ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 with Priority: HIGHEST for action security_group_members [ 1111.645802] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 with Priority: HIGHEST for action security_group_members [ 1111.646120] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-9619a08c-5035-47ce-91cf-089cdb9ae303 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.646239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.646302] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.646502] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.646651] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.647426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.647426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.647426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.647426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.647426] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9619a08c-5035-47ce-91cf-089cdb9ae303',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.900643] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.900643] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.900643] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.900643] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.900643] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.900643] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 1111.979288] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.979288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.979288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.979288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.979288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.994696] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 1112.014309] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.014309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.014309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.014309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.033283] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Unable to find Resource=/policy/api/v1/infra/domains/default/security-policies/7cdb20c0-2042-4cd0-941c-043033c0364c/rules [ 1112.033477] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function GET Argumetns {'path': '/policy/api/v1/infra/domains/default/security-policies/7cdb20c0-2042-4cd0-941c-043033c0364c/rules', 'params': {'page_size': 200, 'cursor': ''}} Response=Error Code=400 Message=b'{\n "httpStatus" : "BAD_REQUEST",\n "error_code" : 500012,\n "module_name" : "Policy",\n "error_message" : "The path=[/infra/domains/default/security-policies/7cdb20c0-2042-4cd0-941c-043033c0364c] is invalid"\n}' {{(pid=66519) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:93}} [ 1112.033596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.034321] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.034321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.034321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.034321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.034321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.034493] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdb20c0-2042-4cd0-941c-043033c0364c is going to be updated. [ 1112.073982] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.073982] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.073982] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.073982] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.073982] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.085134] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdb20c0-2042-4cd0-941c-043033c0364c in Status: IN_PROGRESS for 2s [ 1112.150009] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.150009] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.150009] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.150009] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.174317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.174618] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.174736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.174802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.175018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.175112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.175206] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 is going to be updated. [ 1112.205025] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.205025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.205025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.205248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.205351] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.214545] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 in Status: IN_PROGRESS for 2s [ 1112.493403] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: SUCCESS [ 1112.493656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.493825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.494052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.494244] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.494360] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.494422] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.494571] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.494651] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.494747] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.922316] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 in Status: SUCCESS [ 1112.922521] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 deletion is rescheduled due to dependency. [ 1112.922630] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.997284] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.274456] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1113.274592] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e deletion is rescheduled due to dependency. [ 1113.274629] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.501092] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.521555] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07045da6-f782-414e-a106-61339a5520a8 in Status: SUCCESS [ 1113.521872] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.522157] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.522477] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.522749] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.522915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.523022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.523258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.523374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.523504] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.523635] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.002761] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.003057] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.003057] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.003204] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.003363] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.003457] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be updated. [ 1114.005990] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 1114.006209] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.027062] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.036528] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.036724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.036779] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.036978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.037132] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.047372] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: IN_PROGRESS for 2s [ 1114.095050] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7cdb20c0-2042-4cd0-941c-043033c0364c in Status: SUCCESS [ 1114.095050] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7cdb20c0-2042-4cd0-941c-043033c0364c deletion is rescheduled due to dependency. [ 1114.095050] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7cdb20c0-2042-4cd0-941c-043033c0364c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.226505] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 in Status: SUCCESS [ 1114.226690] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9619a08c-5035-47ce-91cf-089cdb9ae303 deletion is rescheduled due to dependency. [ 1114.226832] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9619a08c-5035-47ce-91cf-089cdb9ae303" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.530241] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07045da6-f782-414e-a106-61339a5520a8: rpc.has_security_group_logging(os_id): False [ 1114.561458] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.561689] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.561689] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.561876] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.594476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.594911] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.595164] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.595285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.595580] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.595727] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.595870] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07045da6-f782-414e-a106-61339a5520a8 is going to be updated. [ 1114.669407] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.669574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.669619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.669928] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.670098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.687311] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07045da6-f782-414e-a106-61339a5520a8 in Status: IN_PROGRESS for 2s [ 1115.030108] env[66519]: INFO networking_nsxv3.common.synchronization [req-c3578b9c-2528-4692-a1ad-04f5d6380608 req-bdda87c9-253f-4485-a668-b9ea46ba0a4e tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 with Priority: HIGHEST for action security_group_members [ 1115.030362] env[66519]: INFO networking_nsxv3.common.synchronization [req-c3578b9c-2528-4692-a1ad-04f5d6380608 req-bdda87c9-253f-4485-a668-b9ea46ba0a4e tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f with Priority: HIGHEST for action security_group_members [ 1115.031052] env[66519]: INFO networking_nsxv3.common.synchronization [req-c3578b9c-2528-4692-a1ad-04f5d6380608 req-bdda87c9-253f-4485-a668-b9ea46ba0a4e tempest-SecurityGroupsTestJSON-1677226030 tempest-SecurityGroupsTestJSON-1677226030-project-member] Enqueued Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1115.032085] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 with Priority: HIGHEST for action security_group_members [ 1115.032319] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f with Priority: HIGHEST for action security_group_members [ 1115.032639] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 with Priority: HIGHEST for action security_group_members [ 1115.032923] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a51e17dc-f2f0-443a-9853-7cd6fa24da87 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.033193] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.033368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.033691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.033921] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.034211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.034211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.034378] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.034502] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.034629] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.035519] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.035696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.035804] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.035997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.036202] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.036342] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.036438] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.036642] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.036746] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.036905] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ac79ffc-f04a-42fd-81ac-d6a0498a399f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.037890] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.038043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.539507] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.539669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.539740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.540042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.541455] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.541545] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.563229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.563472] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.563587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.563662] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.563870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.564021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.564092] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 is going to be updated. [ 1115.565122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.565310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.586020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.586313] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.586460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.586531] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.586743] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.586844] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.586939] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f is going to be updated. [ 1115.601497] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.601639] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.601712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.601937] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.602098] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.609991] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 in Status: IN_PROGRESS for 2s [ 1115.619465] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.619633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.619674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.619904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.620119] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.630158] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f in Status: IN_PROGRESS for 2s [ 1116.057210] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: SUCCESS [ 1116.057554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.057600] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.057809] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.058056] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.058190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.058254] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.058415] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.058496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.058584] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.058866] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.060298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.060298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.060298] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.060298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.060298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.060511] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.060511] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.060511] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.562994] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.563194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.563498] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.563781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.563781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.564025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.591484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.591484] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.591484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.591484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.591747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.591747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.591800] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be updated. [ 1116.607668] env[66519]: INFO networking_nsxv3.common.synchronization [None req-4504bc77-9c9b-4332-8a66-5bdebaa5fc8e tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1116.608720] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1116.609302] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.609649] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.609729] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.609930] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.610561] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.610673] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.610744] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.610911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.610998] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.611113] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.622140] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.622203] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.622252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.622457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.622590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.633871] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: IN_PROGRESS for 2s [ 1116.703407] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07045da6-f782-414e-a106-61339a5520a8 in Status: SUCCESS [ 1116.703596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.116762] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.117088] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.117088] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.120600] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.140176] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.141234] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.141739] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.142016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.143021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.143021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.143021] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be updated. [ 1117.168589] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.168833] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.168969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.169307] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.169537] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.188319] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: IN_PROGRESS for 2s [ 1117.623242] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 in Status: SUCCESS [ 1117.623466] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 deletion is rescheduled due to dependency. [ 1117.623583] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.639734] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f in Status: SUCCESS [ 1117.639920] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ac79ffc-f04a-42fd-81ac-d6a0498a399f deletion is rescheduled due to dependency. [ 1117.640074] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ac79ffc-f04a-42fd-81ac-d6a0498a399f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.646175] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: SUCCESS [ 1118.646457] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 deletion is rescheduled due to dependency. [ 1118.646457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.647311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.647311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.647311] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.647311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.647311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.648016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.648016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.648016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.648233] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-c4947ab6-b221-4af2-81e1-008fe8a07c25 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.648233] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.648374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.648419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.648560] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.648645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.648727] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.648831] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.649040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.649172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.649288] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.152404] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c4947ab6-b221-4af2-81e1-008fe8a07c25: rpc.has_security_group_logging(os_id): False [ 1119.175832] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.175991] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.176073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.176276] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.178141] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.178141] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.178141] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.178141] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.178486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.178515] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.178803] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.178959] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.179077] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.179281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.179712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.179976] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.180100] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.180163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.180309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.180384] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.180469] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be updated. [ 1119.198019] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: SUCCESS [ 1119.198394] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 deletion is rescheduled due to dependency. [ 1119.198616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.253259] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.253607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.253903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.254329] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.254609] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.280126] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: IN_PROGRESS for 2s [ 1120.438905] env[66519]: INFO networking_nsxv3.common.synchronization [req-78d0641c-7d4c-4a9b-8903-3aa6e2ba1f83 req-1e6c380f-1114-4390-ae74-8ae375d44575 tempest-ServersTestJSON-971253557 tempest-ServersTestJSON-971253557-project-member] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1120.439528] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGHEST for action security_group_members [ 1120.439934] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.439934] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.440070] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.440229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.440379] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.440474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.440533] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.440672] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.440754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.440852] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.943143] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.943269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.943370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.943576] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.971234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.971234] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.971234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.971234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.971234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.971234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.971509] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be updated. [ 1121.006456] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.006750] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.006869] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.007195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.007409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.019164] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: IN_PROGRESS for 2s [ 1121.224596] env[66519]: INFO networking_nsxv3.common.synchronization [req-7ba6eec9-d8a8-4c2a-b78a-a33df9ce0775 req-d630bd50-64ea-4d02-a900-d33e45561e73 tempest-DeleteServersTestJSON-1278201394 tempest-DeleteServersTestJSON-1278201394-project-member] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1121.225445] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1121.225745] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.225866] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.226110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.226197] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.226347] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.226441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.226495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.226639] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.226728] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.226818] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.302245] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 in Status: SUCCESS [ 1121.302460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.302641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.302865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.302949] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c4947ab6-b221-4af2-81e1-008fe8a07c25',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.591993] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-42 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.591993] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.592405] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.592547] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.592891] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.593313] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.593627] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.594490] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.594490] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.594490] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1121.594667] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1121.594916] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1121.595099] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1121.595587] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1121.595587] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1121.595689] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1121.616481] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1121.616718] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1121.616912] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1121.617181] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.617608] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-0bb32e27-d758-4696-b7a8-5295d156ba42 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.617844] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-0bb32e27-d758-4696-b7a8-5295d156ba42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.618030] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-0bb32e27-d758-4696-b7a8-5295d156ba42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.619236] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-0bb32e27-d758-4696-b7a8-5295d156ba42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.619434] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bb32e27-d758-4696-b7a8-5295d156ba42',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.729340] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.729663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.729846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.730171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.730300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.730592] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.730730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.730827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.731050] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.731171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.731311] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1121.770974] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.771214] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.771271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.771524] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.771691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.783013] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1121.829357] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.829570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.829570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.829775] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.829933] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.829981] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c4947ab6-b221-4af2-81e1-008fe8a07c25 is going to be deleted. [ 1121.893150] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.893360] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.893360] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.893578] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.893669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.893790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c4947ab6-b221-4af2-81e1-008fe8a07c25" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.122987] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.122987] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.122987] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.123272] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.123272] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.123416] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 0bb32e27-d758-4696-b7a8-5295d156ba42 not found, creating... [ 1122.123673] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.123831] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.123947] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.124199] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.124322] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.124602] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.124759] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.124872] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.125088] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.125220] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.125365] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 0bb32e27-d758-4696-b7a8-5295d156ba42 is going to be created. [ 1122.147253] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.147478] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.148451] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.148451] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.148451] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.148451] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-0bb32e27-d758-4696-b7a8-5295d156ba42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.803298] env[66519]: INFO networking_nsxv3.common.synchronization [None req-cb981b13-c89b-417a-aea1-8167beb2f005 None None] Enqueued Resource ID: a7313277-f60e-4365-94d9-b6b867ddf7fc with Priority: HIGHEST for action port [ 1122.803851] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7313277-f60e-4365-94d9-b6b867ddf7fc with Priority: HIGHEST for action port [ 1122.804686] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7313277-f60e-4365-94d9-b6b867ddf7fc taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.805475] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7313277-f60e-4365-94d9-b6b867ddf7fc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.805803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7313277-f60e-4365-94d9-b6b867ddf7fc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.806148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7313277-f60e-4365-94d9-b6b867ddf7fc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.806290] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7313277-f60e-4365-94d9-b6b867ddf7fc',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.916844] env[66519]: INFO networking_nsxv3.common.synchronization [req-7ba6eec9-d8a8-4c2a-b78a-a33df9ce0775 req-f88e8126-18ad-43f5-9871-777485c8a9ad service nova] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_rules [ 1122.916844] env[66519]: INFO networking_nsxv3.common.synchronization [req-7ba6eec9-d8a8-4c2a-b78a-a33df9ce0775 req-f88e8126-18ad-43f5-9871-777485c8a9ad service nova] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1122.917133] env[66519]: INFO networking_nsxv3.common.synchronization [req-7ba6eec9-d8a8-4c2a-b78a-a33df9ce0775 req-f88e8126-18ad-43f5-9871-777485c8a9ad service nova] Enqueued Resource ID: 0bb32e27-d758-4696-b7a8-5295d156ba42 with Priority: HIGHEST for action port [ 1122.917544] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_rules [ 1122.917685] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1122.917781] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bb32e27-d758-4696-b7a8-5295d156ba42 with Priority: HIGHEST for action port [ 1122.922331] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.922331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.922331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.922331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.922331] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.922331] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.922331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.922331] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bb32e27-d758-4696-b7a8-5295d156ba42 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.922331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bb32e27-d758-4696-b7a8-5295d156ba42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.922331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bb32e27-d758-4696-b7a8-5295d156ba42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.922331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bb32e27-d758-4696-b7a8-5295d156ba42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.922735] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bb32e27-d758-4696-b7a8-5295d156ba42',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.031137] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 in Status: SUCCESS [ 1123.031369] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 deletion is rescheduled due to dependency. [ 1123.031508] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.308527] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7313277-f60e-4365-94d9-b6b867ddf7fc [ 1123.308782] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.310120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.310120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.310359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.310461] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.310568] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7313277-f60e-4365-94d9-b6b867ddf7fc already deleted. [ 1123.310651] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7313277-f60e-4365-94d9-b6b867ddf7fc" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.423955] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.424439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.424439] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0bb32e27-d758-4696-b7a8-5295d156ba42 with status ACTIVE [ 1123.424553] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.424613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.424657] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.424852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.424941] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.425132] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.425229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.425293] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.425446] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.425520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.425702] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.425827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.425880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.425984] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.426068] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.426148] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0bb32e27-d758-4696-b7a8-5295d156ba42 is going to be updated. [ 1123.455202] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.456071] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.456071] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.456071] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.456623] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.457443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bb32e27-d758-4696-b7a8-5295d156ba42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.608565] env[66519]: INFO networking_nsxv3.common.synchronization [None req-83ec562c-e1da-4738-aec8-0373c152ef1b tempest-AttachVolumeTestJSON-862216491 tempest-AttachVolumeTestJSON-862216491-project-member] Enqueued Resource ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa with Priority: HIGHEST for action security_group_rules [ 1123.608565] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa with Priority: HIGHEST for action security_group_rules [ 1123.608565] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.608565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.608565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.609111] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.609205] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fed4f4c3-50a3-4a15-90e4-9a91623b80fa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.795315] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1123.795550] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e deletion is rescheduled due to dependency. [ 1123.795660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.795825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.796046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.796235] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.796350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.796456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.796596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.796680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.796778] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.918434] env[66519]: INFO networking_nsxv3.common.synchronization [None req-3a417093-9587-4ea3-b581-8834c00ee43a tempest-AttachVolumeTestJSON-862216491 tempest-AttachVolumeTestJSON-862216491-project-member] Enqueued Resource ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa with Priority: HIGHEST for action security_group_rules [ 1123.919060] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa with Priority: HIGHEST for action security_group_rules [ 1123.920110] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.920249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.132811] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.133168] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.133168] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.133273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.133407] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.133488] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa already deleted. [ 1124.133542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.133712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.133816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.133913] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fed4f4c3-50a3-4a15-90e4-9a91623b80fa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.300560] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.658028] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.658215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.658255] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.658467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.658563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.658697] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa already deleted. [ 1124.658745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.802938] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.307024] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.307024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.307024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.307458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.307458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.307458] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1125.338821] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.339066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.339066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.340345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.340345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.350073] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1125.453864] env[66519]: INFO networking_nsxv3.common.synchronization [None req-bd605ee0-7b1f-43b7-89ac-c7156c058acd None None] Enqueued Resource ID: 5da7fdb3-2a67-4fb5-a081-29b7a337faae with Priority: HIGHEST for action port [ 1125.453864] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5da7fdb3-2a67-4fb5-a081-29b7a337faae with Priority: HIGHEST for action port [ 1125.453864] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-5da7fdb3-2a67-4fb5-a081-29b7a337faae taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.456041] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5da7fdb3-2a67-4fb5-a081-29b7a337faae" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.456041] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5da7fdb3-2a67-4fb5-a081-29b7a337faae" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.456041] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5da7fdb3-2a67-4fb5-a081-29b7a337faae" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.456041] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5da7fdb3-2a67-4fb5-a081-29b7a337faae',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.957256] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5da7fdb3-2a67-4fb5-a081-29b7a337faae [ 1125.957256] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.957484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.957484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.957708] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.957803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.957910] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5da7fdb3-2a67-4fb5-a081-29b7a337faae already deleted. [ 1125.958175] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5da7fdb3-2a67-4fb5-a081-29b7a337faae" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.363720] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1127.364109] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.364165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.364358] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.364583] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.364665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.364726] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.365090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.365090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.365090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.365386] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.554721] env[66519]: INFO networking_nsxv3.common.synchronization [req-00e6172a-f79a-4139-a928-ac4bce21630d req-b63dc75a-c8aa-4b00-aac7-4879aa7bef95 tempest-ServerActionsTestOtherA-1261634680 tempest-ServerActionsTestOtherA-1261634680-project-member] Enqueued Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGHEST for action security_group_members [ 1127.555779] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGHEST for action security_group_members [ 1127.556298] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.556504] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.556599] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.557460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.557460] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.557460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.557460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.557644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.557705] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.557833] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e8b7135-b92c-4b10-aa25-eb568bfe0ab7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.869015] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.869324] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.869324] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.869632] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.869873] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.870032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.870106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.870342] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.870466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.870598] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.870711] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.870794] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.870848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.870996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.871174] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.871285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.871346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.871489] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.871558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.871640] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.871787] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.979577] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-320 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.979780] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.979903] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.980275] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.980569] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.980759] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.980903] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.981163] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.981410] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.981728] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1127.981873] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.982019] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.982147] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.982286] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1127.982413] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.982569] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1128.002851] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1128.003041] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1128.003183] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1128.003358] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.003681] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-059a30cc-ec86-40d8-ba6c-b56455abdb22 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.003850] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-059a30cc-ec86-40d8-ba6c-b56455abdb22" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.003965] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-059a30cc-ec86-40d8-ba6c-b56455abdb22" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.004731] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-059a30cc-ec86-40d8-ba6c-b56455abdb22" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.004731] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('059a30cc-ec86-40d8-ba6c-b56455abdb22',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.060630] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.060814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.060889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.061124] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.061213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.061526] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.061643] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.061705] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.061856] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.061930] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.062075] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 is going to be deleted. [ 1128.090581] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.090762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.090762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.090977] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.091105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.091210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.374092] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 811de0c5-86ee-4ef7-afc3-0946a87f0b2e: rpc.has_security_group_logging(os_id): False [ 1128.393905] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.393905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.393905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.393905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.393905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.393905] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.394219] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.394219] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.394280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.394318] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.394501] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.395120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.395120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.395120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.395120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.395120] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.395120] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.395495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.395495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.395495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.395495] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1128.460441] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.460610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.460698] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.460968] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.461156] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.475931] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1128.507636] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.508099] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.508099] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.508399] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.508549] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.508714] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 059a30cc-ec86-40d8-ba6c-b56455abdb22 not found, creating... [ 1128.509132] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.509363] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.509513] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.509782] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.509988] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.510371] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.510570] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.510689] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.510900] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.511045] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.511186] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 059a30cc-ec86-40d8-ba6c-b56455abdb22 is going to be created. [ 1128.531199] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.531456] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.531592] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.531831] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.532785] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.532785] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-059a30cc-ec86-40d8-ba6c-b56455abdb22" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.911261] env[66519]: INFO networking_nsxv3.common.synchronization [None req-7a363d3a-088e-403b-b1b2-4568ee423c4a None None] Enqueued Resource ID: ab175e7a-313c-45a3-a13b-79671fd5ba22 with Priority: HIGHEST for action port [ 1128.911808] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab175e7a-313c-45a3-a13b-79671fd5ba22 with Priority: HIGHEST for action port [ 1128.912116] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab175e7a-313c-45a3-a13b-79671fd5ba22 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.912268] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab175e7a-313c-45a3-a13b-79671fd5ba22" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.912369] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab175e7a-313c-45a3-a13b-79671fd5ba22" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.912688] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab175e7a-313c-45a3-a13b-79671fd5ba22" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.912749] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab175e7a-313c-45a3-a13b-79671fd5ba22',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.211727] env[66519]: INFO networking_nsxv3.common.synchronization [req-00e6172a-f79a-4139-a928-ac4bce21630d req-96aa847e-7b8f-4336-9c13-8054fb8094dc service nova] Enqueued Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGHEST for action security_group_rules [ 1129.211937] env[66519]: INFO networking_nsxv3.common.synchronization [req-00e6172a-f79a-4139-a928-ac4bce21630d req-96aa847e-7b8f-4336-9c13-8054fb8094dc service nova] Enqueued Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGHEST for action security_group_members [ 1129.212083] env[66519]: INFO networking_nsxv3.common.synchronization [req-00e6172a-f79a-4139-a928-ac4bce21630d req-96aa847e-7b8f-4336-9c13-8054fb8094dc service nova] Enqueued Resource ID: 059a30cc-ec86-40d8-ba6c-b56455abdb22 with Priority: HIGHEST for action port [ 1129.212593] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGHEST for action security_group_rules [ 1129.212727] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGHEST for action security_group_members [ 1129.212821] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 059a30cc-ec86-40d8-ba6c-b56455abdb22 with Priority: HIGHEST for action port [ 1129.213324] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.213492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.214156] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.214439] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.214591] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e8b7135-b92c-4b10-aa25-eb568bfe0ab7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.215596] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.215857] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.216038] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.216345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.216832] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.216832] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.216832] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.217133] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.217421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.217421] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e8b7135-b92c-4b10-aa25-eb568bfe0ab7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.218871] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-059a30cc-ec86-40d8-ba6c-b56455abdb22 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.218871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-059a30cc-ec86-40d8-ba6c-b56455abdb22" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.218871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-059a30cc-ec86-40d8-ba6c-b56455abdb22" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.218871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-059a30cc-ec86-40d8-ba6c-b56455abdb22" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.219483] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('059a30cc-ec86-40d8-ba6c-b56455abdb22',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.414649] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab175e7a-313c-45a3-a13b-79671fd5ba22 [ 1129.414907] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.415660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.415816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.416073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.416201] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.416636] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab175e7a-313c-45a3-a13b-79671fd5ba22 already deleted. [ 1129.416636] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab175e7a-313c-45a3-a13b-79671fd5ba22" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.722183] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1e8b7135-b92c-4b10-aa25-eb568bfe0ab7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.723574] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.723574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.723799] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 059a30cc-ec86-40d8-ba6c-b56455abdb22 with status ACTIVE [ 1129.723923] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.724025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.724074] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.724253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.724339] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.724518] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.724614] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.724675] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.724829] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.724903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.725105] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.725203] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.725252] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.725405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.725533] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.725632] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 059a30cc-ec86-40d8-ba6c-b56455abdb22 is going to be updated. [ 1129.761489] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.761687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.761747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.761926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.762082] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.762680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-059a30cc-ec86-40d8-ba6c-b56455abdb22" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.227620] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1e8b7135-b92c-4b10-aa25-eb568bfe0ab7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.374931] env[66519]: INFO networking_nsxv3.common.synchronization [req-61e83dc4-79a0-421d-9274-0ff5a8dd564d req-8c1f6ed2-0a4e-47ed-97de-506b4c0dac24 tempest-AttachVolumeTestJSON-862216491 tempest-AttachVolumeTestJSON-862216491-project-member] Enqueued Resource ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa with Priority: HIGHEST for action security_group_members [ 1130.375523] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa with Priority: HIGHEST for action security_group_members [ 1130.375843] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.375964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.376138] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.376652] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.376652] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.376652] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.376652] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.376864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.376864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.376970] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fed4f4c3-50a3-4a15-90e4-9a91623b80fa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.492526] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1130.493205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.732148] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.732148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.732148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.732148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.732148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.732368] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 is going to be created. [ 1130.742536] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-17 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.742725] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-17" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.742845] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-17" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.743211] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-17" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.743482] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.743640] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.743754] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.743967] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.744129] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.744367] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.744494] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.744628] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.744737] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.744845] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.744947] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.745100] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.760951] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.761158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.761226] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.761386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.761547] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.765188] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.765336] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1130.765491] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.765633] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-17" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.765963] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-8c24fc16-f51c-41d3-bdd6-27392729a80e taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.766190] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-8c24fc16-f51c-41d3-bdd6-27392729a80e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.766257] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-8c24fc16-f51c-41d3-bdd6-27392729a80e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.766561] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-8c24fc16-f51c-41d3-bdd6-27392729a80e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.766714] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c24fc16-f51c-41d3-bdd6-27392729a80e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.773869] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 in Status: UNINITIALIZED for 2s [ 1130.879320] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.879504] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.879504] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.880193] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.880193] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.880193] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.880193] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.880193] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.880441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.880473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.880539] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa already deleted. [ 1130.880622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.114683] env[66519]: INFO networking_nsxv3.common.synchronization [None req-3539907a-86f7-4004-a76a-0cfaa0031867 None None] Enqueued Resource ID: e82f56f8-79dd-4a32-97c3-c5803f3f2dee with Priority: HIGHEST for action port [ 1131.114683] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e82f56f8-79dd-4a32-97c3-c5803f3f2dee with Priority: HIGHEST for action port [ 1131.114683] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-e82f56f8-79dd-4a32-97c3-c5803f3f2dee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.114683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e82f56f8-79dd-4a32-97c3-c5803f3f2dee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.114683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e82f56f8-79dd-4a32-97c3-c5803f3f2dee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.114961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e82f56f8-79dd-4a32-97c3-c5803f3f2dee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.114961] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e82f56f8-79dd-4a32-97c3-c5803f3f2dee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.269596] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.269849] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.269951] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.270363] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.270533] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.270683] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 8c24fc16-f51c-41d3-bdd6-27392729a80e not found, creating... [ 1131.270944] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.271121] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.271230] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.271464] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.271597] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.271878] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.272043] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.272159] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.272381] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.272525] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.272792] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 8c24fc16-f51c-41d3-bdd6-27392729a80e is going to be created. [ 1131.315583] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.315881] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.316053] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.316400] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.316807] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.317138] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-8c24fc16-f51c-41d3-bdd6-27392729a80e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.616526] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e82f56f8-79dd-4a32-97c3-c5803f3f2dee [ 1131.616767] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.616953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.617084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.617328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.617453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.617578] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e82f56f8-79dd-4a32-97c3-c5803f3f2dee already deleted. [ 1131.617684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e82f56f8-79dd-4a32-97c3-c5803f3f2dee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.013337] env[66519]: INFO networking_nsxv3.common.synchronization [req-61e83dc4-79a0-421d-9274-0ff5a8dd564d req-ade9619a-c437-4757-87f9-bf44f07c0c4e service nova] Enqueued Resource ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa with Priority: HIGHEST for action security_group_rules [ 1132.013512] env[66519]: INFO networking_nsxv3.common.synchronization [req-61e83dc4-79a0-421d-9274-0ff5a8dd564d req-ade9619a-c437-4757-87f9-bf44f07c0c4e service nova] Enqueued Resource ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa with Priority: HIGHEST for action security_group_members [ 1132.013781] env[66519]: INFO networking_nsxv3.common.synchronization [req-61e83dc4-79a0-421d-9274-0ff5a8dd564d req-ade9619a-c437-4757-87f9-bf44f07c0c4e service nova] Enqueued Resource ID: 8c24fc16-f51c-41d3-bdd6-27392729a80e with Priority: HIGHEST for action port [ 1132.014358] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa with Priority: HIGHEST for action security_group_rules [ 1132.014511] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa with Priority: HIGHEST for action security_group_members [ 1132.014581] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c24fc16-f51c-41d3-bdd6-27392729a80e with Priority: HIGHEST for action port [ 1132.014859] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.014984] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.015066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.015247] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.015322] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fed4f4c3-50a3-4a15-90e4-9a91623b80fa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.018309] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.018309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.018309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.018309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.018309] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.018309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.018309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.018309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.018309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.018309] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fed4f4c3-50a3-4a15-90e4-9a91623b80fa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.019231] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c24fc16-f51c-41d3-bdd6-27392729a80e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.019231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c24fc16-f51c-41d3-bdd6-27392729a80e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.019624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c24fc16-f51c-41d3-bdd6-27392729a80e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.019624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c24fc16-f51c-41d3-bdd6-27392729a80e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.019624] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c24fc16-f51c-41d3-bdd6-27392729a80e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.521268] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.521518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.521642] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fed4f4c3-50a3-4a15-90e4-9a91623b80fa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.522709] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c24fc16-f51c-41d3-bdd6-27392729a80e with status ACTIVE [ 1132.522915] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.523066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.523137] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.523420] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.523515] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.523752] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.523827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.523884] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.524021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.524226] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.524281] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.524359] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.524455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.524610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.524684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.524850] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c24fc16-f51c-41d3-bdd6-27392729a80e is going to be updated. [ 1132.550896] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.551145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.551210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.551460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.551606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.551770] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c24fc16-f51c-41d3-bdd6-27392729a80e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.786966] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 in Status: SUCCESS [ 1132.787897] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.788374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.788482] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.789479] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.789479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.789479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.789479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.789479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.789479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.789479] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1e8b7135-b92c-4b10-aa25-eb568bfe0ab7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.026882] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fed4f4c3-50a3-4a15-90e4-9a91623b80fa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.292026] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.292026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.292026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.292314] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.292457] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.292554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.292609] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.292752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.292843] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.292942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.293090] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.293185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.293245] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.293384] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.293521] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.293612] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.293669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.293807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.293879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.293956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.294054] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1e8b7135-b92c-4b10-aa25-eb568bfe0ab7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.517615] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.517891] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.518043] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.518318] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.518653] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.518856] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.519018] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.519608] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.519759] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.519974] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1133.520149] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1133.520272] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1133.520380] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1133.520491] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1133.520594] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1133.520726] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1133.529169] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.529298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.529373] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.529560] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.529646] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.529801] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa is going to be created. [ 1133.545418] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1133.545596] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1133.545781] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1133.546087] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.546504] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-4e01beb5-c9f9-4836-aca2-909d291db5be taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.546692] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-4e01beb5-c9f9-4836-aca2-909d291db5be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.546814] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-4e01beb5-c9f9-4836-aca2-909d291db5be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.547251] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-4e01beb5-c9f9-4836-aca2-909d291db5be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.547422] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e01beb5-c9f9-4836-aca2-909d291db5be',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.558352] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.558520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.558560] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.558935] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.559028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.569775] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa in Status: UNINITIALIZED for 2s [ 1133.797323] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7: rpc.has_security_group_logging(os_id): False [ 1133.818924] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.819135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.819233] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.819574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.819574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.819738] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.819889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.819889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.820454] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.820454] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.820454] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.820633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.820633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.820735] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.820812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.821019] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.821019] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.821208] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.821305] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.821346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.821426] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 is going to be created. [ 1133.901045] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.901357] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.901444] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.901759] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.902017] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.917350] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 in Status: IN_PROGRESS for 2s [ 1134.050415] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.050732] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.050898] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.051299] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.051630] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.051739] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 4e01beb5-c9f9-4836-aca2-909d291db5be not found, creating... [ 1134.052148] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.052319] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.052475] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.052783] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.052940] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.053562] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.053562] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.053790] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.053966] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.054191] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.054404] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 4e01beb5-c9f9-4836-aca2-909d291db5be is going to be created. [ 1134.100321] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.100627] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.100764] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.101057] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.101303] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.101559] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-4e01beb5-c9f9-4836-aca2-909d291db5be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.854173] env[66519]: INFO networking_nsxv3.common.synchronization [req-b7a6928c-0d3c-4cbf-8ae1-b2fd0d471ce7 req-64ae6c05-571a-4340-875a-73597f02eaa1 service nova] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_rules [ 1134.854464] env[66519]: INFO networking_nsxv3.common.synchronization [req-b7a6928c-0d3c-4cbf-8ae1-b2fd0d471ce7 req-64ae6c05-571a-4340-875a-73597f02eaa1 service nova] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1134.854523] env[66519]: INFO networking_nsxv3.common.synchronization [req-b7a6928c-0d3c-4cbf-8ae1-b2fd0d471ce7 req-64ae6c05-571a-4340-875a-73597f02eaa1 service nova] Enqueued Resource ID: 4e01beb5-c9f9-4836-aca2-909d291db5be with Priority: HIGHEST for action port [ 1134.855204] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_rules [ 1134.855204] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1134.855390] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e01beb5-c9f9-4836-aca2-909d291db5be with Priority: HIGHEST for action port [ 1134.855627] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.855761] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.855909] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.856047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.856144] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.857056] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.857219] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.857315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.857485] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.857606] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.857707] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.857776] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.857928] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.858025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.858124] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.859685] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e01beb5-c9f9-4836-aca2-909d291db5be taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.859808] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e01beb5-c9f9-4836-aca2-909d291db5be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.859886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e01beb5-c9f9-4836-aca2-909d291db5be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.860300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e01beb5-c9f9-4836-aca2-909d291db5be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.860300] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e01beb5-c9f9-4836-aca2-909d291db5be',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.878990] env[66519]: INFO networking_nsxv3.common.synchronization [req-96c5f35f-1559-49d6-8ec1-2ed23778f8ef req-3365fab4-e2ee-4adf-a5f5-2ff8a98acfa3 tempest-ServerAddressesNegativeTestJSON-1915909052 tempest-ServerAddressesNegativeTestJSON-1915909052-project-member] Enqueued Resource ID: 41789fc3-4591-4110-9aa7-18f52baf4691 with Priority: HIGHEST for action security_group_members [ 1134.879769] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41789fc3-4591-4110-9aa7-18f52baf4691 with Priority: HIGHEST for action security_group_members [ 1134.880123] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-41789fc3-4591-4110-9aa7-18f52baf4691 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.880257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.880317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.880572] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.881017] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.881017] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.881017] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.881210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.881210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.881271] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41789fc3-4591-4110-9aa7-18f52baf4691',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.242875] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-117 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.243172] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-117" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.243303] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-117" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.243681] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-117" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.243963] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.244206] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.244350] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.244636] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.244847] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.245023] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.245386] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.245525] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.245637] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.245801] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.245871] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.245992] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.282053] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.282293] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1135.282467] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.282615] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-117" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.282976] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-594743e7-bb31-4142-9be3-6e560b1e6c93 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.283221] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-594743e7-bb31-4142-9be3-6e560b1e6c93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.283453] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-594743e7-bb31-4142-9be3-6e560b1e6c93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.283711] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-594743e7-bb31-4142-9be3-6e560b1e6c93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.283923] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('594743e7-bb31-4142-9be3-6e560b1e6c93',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.362322] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.363917] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.364103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.364283] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e01beb5-c9f9-4836-aca2-909d291db5be with status ACTIVE [ 1135.364457] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.364567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.364633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.364915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.365025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.365278] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.365402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.365480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.365707] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.366394] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.366394] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.366394] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.366394] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.366980] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.366980] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.366980] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e01beb5-c9f9-4836-aca2-909d291db5be is going to be updated. [ 1135.383687] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.383870] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.383937] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.384588] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.384588] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.384745] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.384864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.384929] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.385108] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.385178] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.385267] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41789fc3-4591-4110-9aa7-18f52baf4691 already deleted. [ 1135.385347] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.393412] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.393566] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.393630] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.393840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.393980] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.394266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e01beb5-c9f9-4836-aca2-909d291db5be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.578845] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa in Status: SUCCESS [ 1135.579210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.579392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.579616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.579832] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.579976] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.580058] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.580308] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.580417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.580500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.580610] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fed4f4c3-50a3-4a15-90e4-9a91623b80fa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.786730] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.786965] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.787181] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.787535] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.787720] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.787916] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 594743e7-bb31-4142-9be3-6e560b1e6c93 not found, creating... [ 1135.788278] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.788576] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.788737] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.789037] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.789375] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.789727] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.789895] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.790027] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.790433] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.790613] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.790762] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 594743e7-bb31-4142-9be3-6e560b1e6c93 is going to be created. [ 1135.811826] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.812048] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.812190] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.812628] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.812882] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.813244] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-594743e7-bb31-4142-9be3-6e560b1e6c93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.869794] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.929962] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 in Status: SUCCESS [ 1135.930262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.083475] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fed4f4c3-50a3-4a15-90e4-9a91623b80fa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.159035] env[66519]: INFO networking_nsxv3.common.synchronization [req-da02f038-9876-4abc-8222-9af46f91acf5 req-1d201fe0-52fe-4aff-9d72-4fec548f2085 tempest-AttachVolumeNegativeTest-1001897465 tempest-AttachVolumeNegativeTest-1001897465-project-member] Enqueued Resource ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa with Priority: HIGHEST for action security_group_members [ 1136.159577] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa with Priority: HIGHEST for action security_group_members [ 1136.159890] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.160025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.160083] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.160316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.160462] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.160556] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.160613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.160756] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.160839] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.160932] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4090bc61-1cc1-4db7-9c78-0f0fabacd9aa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.375573] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.375809] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.375881] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.376072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.376160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.376264] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be updated. [ 1136.421832] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.422059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.422059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.422416] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.422416] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.432909] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: IN_PROGRESS for 2s [ 1136.498573] env[66519]: INFO networking_nsxv3.common.synchronization [req-96c5f35f-1559-49d6-8ec1-2ed23778f8ef req-231824bf-04ce-4f19-9cd9-e7db1d8922a7 service nova] Enqueued Resource ID: 41789fc3-4591-4110-9aa7-18f52baf4691 with Priority: HIGHEST for action security_group_rules [ 1136.498789] env[66519]: INFO networking_nsxv3.common.synchronization [req-96c5f35f-1559-49d6-8ec1-2ed23778f8ef req-231824bf-04ce-4f19-9cd9-e7db1d8922a7 service nova] Enqueued Resource ID: 41789fc3-4591-4110-9aa7-18f52baf4691 with Priority: HIGHEST for action security_group_members [ 1136.498926] env[66519]: INFO networking_nsxv3.common.synchronization [req-96c5f35f-1559-49d6-8ec1-2ed23778f8ef req-231824bf-04ce-4f19-9cd9-e7db1d8922a7 service nova] Enqueued Resource ID: 594743e7-bb31-4142-9be3-6e560b1e6c93 with Priority: HIGHEST for action port [ 1136.499644] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41789fc3-4591-4110-9aa7-18f52baf4691 with Priority: HIGHEST for action security_group_rules [ 1136.499780] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41789fc3-4591-4110-9aa7-18f52baf4691 with Priority: HIGHEST for action security_group_members [ 1136.499876] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 594743e7-bb31-4142-9be3-6e560b1e6c93 with Priority: HIGHEST for action port [ 1136.500163] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-41789fc3-4591-4110-9aa7-18f52baf4691 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.500292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.500380] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.500705] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.500744] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('41789fc3-4591-4110-9aa7-18f52baf4691',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.501651] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-41789fc3-4591-4110-9aa7-18f52baf4691 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.501793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.501845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.502065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.502148] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.502245] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.502320] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.503506] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.503506] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.503506] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41789fc3-4591-4110-9aa7-18f52baf4691',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.503506] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-594743e7-bb31-4142-9be3-6e560b1e6c93 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.503506] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-594743e7-bb31-4142-9be3-6e560b1e6c93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.503506] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-594743e7-bb31-4142-9be3-6e560b1e6c93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.503811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-594743e7-bb31-4142-9be3-6e560b1e6c93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.503811] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('594743e7-bb31-4142-9be3-6e560b1e6c93',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.585451] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fed4f4c3-50a3-4a15-90e4-9a91623b80fa: rpc.has_security_group_logging(os_id): False [ 1136.602980] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.603177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.603260] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.603469] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.603828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.603901] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.603984] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.604063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.604271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.604369] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.604471] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa is going to be created. [ 1136.663268] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.664296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.664296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.664296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.666818] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.666928] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.687725] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.688022] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.688124] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.688198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.688405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.688490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.688623] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa is going to be updated. [ 1136.689728] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.689904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.690089] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.703901] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa in Status: IN_PROGRESS for 2s [ 1136.743126] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.743322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.743755] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.743755] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.743755] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.765693] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa in Status: IN_PROGRESS for 2s [ 1137.005589] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('41789fc3-4591-4110-9aa7-18f52baf4691',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.007382] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-41789fc3-4591-4110-9aa7-18f52baf4691 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.007382] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.007657] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 594743e7-bb31-4142-9be3-6e560b1e6c93 with status ACTIVE [ 1137.007930] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.010520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.010520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.010520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.010520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.010520] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.010520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.010520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.010520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.010520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.010520] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.010520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.010520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.010520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.010520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.010520] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 594743e7-bb31-4142-9be3-6e560b1e6c93 is going to be updated. [ 1137.031702] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.032244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.032244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.032244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.032389] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.032627] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-594743e7-bb31-4142-9be3-6e560b1e6c93" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.381895] env[66519]: INFO networking_nsxv3.common.synchronization [req-5b106af7-e3c2-4cfc-b18b-b8722c7e28ca req-a976de6c-4124-4306-8d38-6405eed25d3e tempest-ServerActionsTestOtherA-1261634680 tempest-ServerActionsTestOtherA-1261634680-project-member] Enqueued Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGHEST for action security_group_members [ 1137.382867] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGHEST for action security_group_members [ 1137.383487] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.383680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.383783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.384084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.384303] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.384463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.384658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.384909] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.385075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.385231] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1e8b7135-b92c-4b10-aa25-eb568bfe0ab7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.429855] env[66519]: INFO networking_nsxv3.common.synchronization [req-5b106af7-e3c2-4cfc-b18b-b8722c7e28ca req-a976de6c-4124-4306-8d38-6405eed25d3e tempest-ServerActionsTestOtherA-1261634680 tempest-ServerActionsTestOtherA-1261634680-project-member] Enqueued Resource ID: 059a30cc-ec86-40d8-ba6c-b56455abdb22 with Priority: HIGHEST for action port [ 1137.430437] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 059a30cc-ec86-40d8-ba6c-b56455abdb22 with Priority: HIGHEST for action port [ 1137.430798] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-059a30cc-ec86-40d8-ba6c-b56455abdb22 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.430898] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-059a30cc-ec86-40d8-ba6c-b56455abdb22" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.431085] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-059a30cc-ec86-40d8-ba6c-b56455abdb22" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.431466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-059a30cc-ec86-40d8-ba6c-b56455abdb22" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.431536] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('059a30cc-ec86-40d8-ba6c-b56455abdb22',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.512608] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('41789fc3-4591-4110-9aa7-18f52baf4691',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.892079] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.892079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.892079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.892079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.892079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.892079] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.892079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.892079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.892079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.892079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.892079] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 is going to be updated. [ 1137.924019] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.924228] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.924283] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.924555] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.924740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.933682] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 in Status: IN_PROGRESS for 2s [ 1137.933903] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 059a30cc-ec86-40d8-ba6c-b56455abdb22 with status ACTIVE [ 1137.934134] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.934266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.934334] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.934558] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.934648] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.934858] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.935010] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.935069] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.935254] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.935302] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.935456] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.935555] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.935632] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.935775] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.935847] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.935945] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 059a30cc-ec86-40d8-ba6c-b56455abdb22 is going to be updated. [ 1137.960457] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.960655] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.960655] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.960873] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.961042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.961190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-059a30cc-ec86-40d8-ba6c-b56455abdb22" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.016180] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.016180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.016180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.016180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.016180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.016180] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41789fc3-4591-4110-9aa7-18f52baf4691 is going to be created. [ 1138.053680] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.053922] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.054017] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.054289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.054538] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.069409] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41789fc3-4591-4110-9aa7-18f52baf4691 in Status: UNINITIALIZED for 2s [ 1138.445251] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: SUCCESS [ 1138.445480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.446687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.446687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.446687] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.446978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.446978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.447110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.447311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.447673] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.447673] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.719616] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa in Status: SUCCESS [ 1138.719978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.780445] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa in Status: SUCCESS [ 1138.780445] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4090bc61-1cc1-4db7-9c78-0f0fabacd9aa deletion is rescheduled due to dependency. [ 1138.780445] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4090bc61-1cc1-4db7-9c78-0f0fabacd9aa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.890873] env[66519]: INFO networking_nsxv3.common.synchronization [req-b5b8417c-05d4-4690-941b-0d4514a7327b req-d7fb4c4d-1e4c-4fbc-90e3-0bae3b04e07b tempest-DeleteServersTestJSON-1278201394 tempest-DeleteServersTestJSON-1278201394-project-member] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1138.891448] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1138.891751] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.891874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.891948] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.892780] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.892959] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.893083] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.893145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.893310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.893396] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.893489] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.951966] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.951966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.951966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.951966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.951966] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.951966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.951966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.951966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.951966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.951966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.952459] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.952459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.952459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.952459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.953288] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.953288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.953288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.953288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.953288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.953288] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.953496] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.396477] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.396760] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.396760] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.396961] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.397068] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.397323] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.397432] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.397501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.397656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.397734] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.397822] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1139.426096] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.426096] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.426096] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.426096] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.426096] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.436018] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1139.455711] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a5c9fd2-e0f8-469b-9019-610142582634: rpc.has_security_group_logging(os_id): False [ 1139.474022] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.474022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.474022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.474263] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.474312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.474498] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.475171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.475171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.475171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.475171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.475171] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.475171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.475448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.475448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.475448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.475643] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.475740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.475804] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.475947] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.476033] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.476123] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be updated. [ 1139.542779] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.542779] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.542779] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.542779] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.543128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.556650] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: IN_PROGRESS for 2s [ 1139.944804] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 in Status: SUCCESS [ 1139.945425] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 deletion is rescheduled due to dependency. [ 1139.945582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.082142] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41789fc3-4591-4110-9aa7-18f52baf4691 in Status: SUCCESS [ 1140.082346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.082526] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.082879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.083152] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.083322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.083433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.083684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.083813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.083953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.084092] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('41789fc3-4591-4110-9aa7-18f52baf4691',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.586770] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-41789fc3-4591-4110-9aa7-18f52baf4691 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.587203] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.587203] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.587301] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.587498] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.587620] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.587691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.587852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.587944] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.588046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.588207] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-41789fc3-4591-4110-9aa7-18f52baf4691 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.588311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.588391] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.588547] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.588687] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.588782] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.588846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.588988] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.589079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.589166] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.589303] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('41789fc3-4591-4110-9aa7-18f52baf4691',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.092667] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 41789fc3-4591-4110-9aa7-18f52baf4691: rpc.has_security_group_logging(os_id): False [ 1141.110563] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.110764] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.110823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.110987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.111102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.111288] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.111386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.111449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.111621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.111699] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.111897] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.111991] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.112066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.112211] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.112426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.112464] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.112542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.112603] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.112738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.112807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.112898] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 41789fc3-4591-4110-9aa7-18f52baf4691 is going to be created. [ 1141.170345] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.170345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.170345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.170345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.170567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.181775] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41789fc3-4591-4110-9aa7-18f52baf4691 in Status: IN_PROGRESS for 2s [ 1141.453712] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1141.453940] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e deletion is rescheduled due to dependency. [ 1141.454013] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.575803] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: SUCCESS [ 1141.576058] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.197327] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 41789fc3-4591-4110-9aa7-18f52baf4691 in Status: SUCCESS [ 1143.197764] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.892537] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1143.892714] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1147.548181] env[66519]: INFO networking_nsxv3.common.synchronization [req-b018c46b-533e-4ca3-968e-4cb0a34f3ff1 req-d0a319b9-745f-4845-b1b4-8f185e3650bc tempest-ServerAddressesNegativeTestJSON-1915909052 tempest-ServerAddressesNegativeTestJSON-1915909052-project-member] Enqueued Resource ID: 41789fc3-4591-4110-9aa7-18f52baf4691 with Priority: HIGHEST for action security_group_members [ 1147.548991] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41789fc3-4591-4110-9aa7-18f52baf4691 with Priority: HIGHEST for action security_group_members [ 1147.549534] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-41789fc3-4591-4110-9aa7-18f52baf4691 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.549685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.549846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.550316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.550398] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.550500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.550612] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.550867] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.550990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.552400] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('41789fc3-4591-4110-9aa7-18f52baf4691',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.055081] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.055264] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.055310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.055532] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.055627] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.055828] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.055928] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.055993] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.056157] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.056234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.056322] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41789fc3-4591-4110-9aa7-18f52baf4691 is going to be updated. [ 1148.085309] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.085466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.085512] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.085703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.085851] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.094749] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41789fc3-4591-4110-9aa7-18f52baf4691 in Status: IN_PROGRESS for 2s [ 1148.209625] env[66519]: INFO networking_nsxv3.common.synchronization [req-005a72a3-60af-4ca2-82dd-7c45508086fd req-7be7936e-33c5-4994-8497-5eb2f529d328 tempest-DeleteServersTestJSON-1278201394 tempest-DeleteServersTestJSON-1278201394-project-member] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1148.210209] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1148.210547] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.210672] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.210739] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.210941] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.211102] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.211195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.211320] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.211392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.211476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.211568] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.533029] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-42 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.533029] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.533029] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.533029] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.533339] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.533620] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.533836] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.534165] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.534408] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.534771] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.535110] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1148.536048] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1148.536048] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1148.536048] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1148.536048] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1148.536230] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1148.557098] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1148.557541] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1148.557541] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1148.557677] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.557913] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-3ed5f979-55a0-42cb-87cb-48d08a203f31 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.558092] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-3ed5f979-55a0-42cb-87cb-48d08a203f31" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.558205] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-3ed5f979-55a0-42cb-87cb-48d08a203f31" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.558515] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-3ed5f979-55a0-42cb-87cb-48d08a203f31" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.558645] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ed5f979-55a0-42cb-87cb-48d08a203f31',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.713920] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.714132] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.714173] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.714379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.714471] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.714679] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.714779] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.714840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.714995] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.715083] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.715169] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1148.746751] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.746940] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.747018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.747239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.747490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.757993] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1149.061798] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.062238] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.062410] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.062711] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.062865] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.063064] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 3ed5f979-55a0-42cb-87cb-48d08a203f31 not found, creating... [ 1149.063357] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.063532] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.063698] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.063976] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.064281] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.064632] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.064799] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.064914] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.065215] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.065380] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.066288] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 3ed5f979-55a0-42cb-87cb-48d08a203f31 is going to be created. [ 1149.087684] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.087946] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.087946] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.088278] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.088612] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.088835] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-3ed5f979-55a0-42cb-87cb-48d08a203f31" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.787037] env[66519]: INFO networking_nsxv3.common.synchronization [req-005a72a3-60af-4ca2-82dd-7c45508086fd req-ea8174dc-1575-4738-8b5a-63eae4800299 service nova] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_rules [ 1149.787517] env[66519]: INFO networking_nsxv3.common.synchronization [req-005a72a3-60af-4ca2-82dd-7c45508086fd req-ea8174dc-1575-4738-8b5a-63eae4800299 service nova] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1149.787517] env[66519]: INFO networking_nsxv3.common.synchronization [req-005a72a3-60af-4ca2-82dd-7c45508086fd req-ea8174dc-1575-4738-8b5a-63eae4800299 service nova] Enqueued Resource ID: 3ed5f979-55a0-42cb-87cb-48d08a203f31 with Priority: HIGHEST for action port [ 1149.788805] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_rules [ 1149.788805] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1149.788805] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed5f979-55a0-42cb-87cb-48d08a203f31 with Priority: HIGHEST for action port [ 1149.788936] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.789237] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.789237] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.789509] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.789599] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.790521] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.791177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.791177] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ed5f979-55a0-42cb-87cb-48d08a203f31 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.791177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ed5f979-55a0-42cb-87cb-48d08a203f31" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.791177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ed5f979-55a0-42cb-87cb-48d08a203f31" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.791377] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ed5f979-55a0-42cb-87cb-48d08a203f31" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.791377] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ed5f979-55a0-42cb-87cb-48d08a203f31',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.871305] env[66519]: INFO networking_nsxv3.common.synchronization [req-cd925280-778f-4ed4-a0a2-69ba0cb7611e req-31647240-274c-4f74-a0e1-0cd7ebbeee9c tempest-AttachVolumeNegativeTest-1001897465 tempest-AttachVolumeNegativeTest-1001897465-project-member] Enqueued Resource ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 with Priority: HIGHEST for action security_group_members [ 1149.871969] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 with Priority: HIGHEST for action security_group_members [ 1149.872265] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.872409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.872502] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.872806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.873032] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.873117] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.873150] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.873308] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.873402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.873478] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e5e7bc4-c260-4f47-9e3e-5384e5bb5347',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.107315] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 41789fc3-4591-4110-9aa7-18f52baf4691 in Status: SUCCESS [ 1150.107315] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 41789fc3-4591-4110-9aa7-18f52baf4691 deletion is rescheduled due to dependency. [ 1150.107429] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-41789fc3-4591-4110-9aa7-18f52baf4691" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.292623] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.292837] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.293016] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ed5f979-55a0-42cb-87cb-48d08a203f31 with status ACTIVE [ 1150.293162] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.293272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.293364] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.293599] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.293688] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.293865] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.293960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.294035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.294186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.294290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.294475] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.294612] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.294694] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.294849] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.294925] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.295019] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ed5f979-55a0-42cb-87cb-48d08a203f31 is going to be updated. [ 1150.317531] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.317706] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.317751] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.317966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.318123] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.318287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ed5f979-55a0-42cb-87cb-48d08a203f31" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.375936] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.376112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.376179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.376405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.401208] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.401487] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.401621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.401685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.401889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.401972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.402090] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 is going to be updated. [ 1150.427612] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.427757] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.427827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.428041] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.428184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.438932] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 in Status: IN_PROGRESS for 2s [ 1150.767717] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1150.767898] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e deletion is rescheduled due to dependency. [ 1150.768462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.768462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.768462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.768643] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.768713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.768749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.768874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.768953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.769056] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.271178] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.775158] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.842229] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.842473] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.842528] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.842868] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.843202] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.843368] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.843485] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.843713] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.843864] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.844087] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1151.844203] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1151.844306] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1151.844411] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1151.844517] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1151.844679] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1151.844746] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1151.873017] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1151.873204] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1151.873324] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1151.873513] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-175" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.873833] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-4e01beb5-c9f9-4836-aca2-909d291db5be taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.874010] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-4e01beb5-c9f9-4836-aca2-909d291db5be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.874143] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-4e01beb5-c9f9-4836-aca2-909d291db5be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.874408] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-4e01beb5-c9f9-4836-aca2-909d291db5be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.874602] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e01beb5-c9f9-4836-aca2-909d291db5be',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.279147] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.279665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.279665] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.279808] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.279949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.280126] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1152.336098] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.336383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.336383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.336517] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.336659] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.346682] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1152.377775] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.378042] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.378123] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.378405] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.378556] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.378842] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.378999] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.379125] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.379413] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.379566] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.379861] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.380028] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.380145] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.380582] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.381323] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.381323] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 4e01beb5-c9f9-4836-aca2-909d291db5be is going to be updated. [ 1152.404589] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.404798] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.404991] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.405221] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.405426] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.405661] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-4e01beb5-c9f9-4836-aca2-909d291db5be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.451138] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 in Status: SUCCESS [ 1152.451313] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e5e7bc4-c260-4f47-9e3e-5384e5bb5347 deletion is rescheduled due to dependency. [ 1152.451450] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e5e7bc4-c260-4f47-9e3e-5384e5bb5347" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.119792] env[66519]: INFO networking_nsxv3.common.synchronization [req-a817cb32-5b21-4c1d-aa4a-6b4c1551414b req-3dedb298-48fa-4455-9f6c-41863c7de8e7 service nova] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_rules [ 1153.120071] env[66519]: INFO networking_nsxv3.common.synchronization [req-a817cb32-5b21-4c1d-aa4a-6b4c1551414b req-3dedb298-48fa-4455-9f6c-41863c7de8e7 service nova] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1153.120796] env[66519]: INFO networking_nsxv3.common.synchronization [req-a817cb32-5b21-4c1d-aa4a-6b4c1551414b req-3dedb298-48fa-4455-9f6c-41863c7de8e7 service nova] Enqueued Resource ID: 4e01beb5-c9f9-4836-aca2-909d291db5be with Priority: HIGHEST for action port [ 1153.120869] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_rules [ 1153.121721] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1153.121946] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e01beb5-c9f9-4836-aca2-909d291db5be with Priority: HIGHEST for action port [ 1153.122345] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.122527] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.122638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.123170] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.123339] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.124927] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.125122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.125234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.125473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.125677] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.125823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.125922] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.126124] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.126810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.126810] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.127287] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e01beb5-c9f9-4836-aca2-909d291db5be taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.127433] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e01beb5-c9f9-4836-aca2-909d291db5be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.127535] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e01beb5-c9f9-4836-aca2-909d291db5be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.127729] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e01beb5-c9f9-4836-aca2-909d291db5be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.127935] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e01beb5-c9f9-4836-aca2-909d291db5be',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.630696] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.630696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.631055] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.632018] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e01beb5-c9f9-4836-aca2-909d291db5be with status ACTIVE [ 1153.632018] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.632150] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.632187] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.632421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.632516] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.632775] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.632921] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.633029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.633223] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.633306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.633508] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.633643] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.633730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.633939] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.634247] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.634571] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e01beb5-c9f9-4836-aca2-909d291db5be is going to be updated. [ 1153.662342] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.662489] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.662563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.662775] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.662910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.663087] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e01beb5-c9f9-4836-aca2-909d291db5be" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.136629] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.357517] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1154.357517] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.357517] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.357517] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.357781] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.357781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.357781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.357963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.358027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.358112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.358201] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.639084] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.639518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.639518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.639619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.639654] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.639859] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be updated. [ 1154.680125] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.680269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.680342] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.680760] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.680760] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.689317] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: IN_PROGRESS for 2s [ 1154.860581] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.860842] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.860842] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.861088] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.861293] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.862622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.862622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.862622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.862622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.862622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.862622] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.862622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.862622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.862622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.862622] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.862622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.862622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.863170] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.863170] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.863170] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.863170] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.090515] env[66519]: INFO networking_nsxv3.common.synchronization [None req-495fc3d5-7621-4ccb-a7f3-f4269724e0fa tempest-AttachVolumeNegativeTest-1001897465 tempest-AttachVolumeNegativeTest-1001897465-project-member] Enqueued Resource ID: 606ca437-1e74-42be-89b5-ede923ce83c7 with Priority: HIGHEST for action security_group_rules [ 1155.091403] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606ca437-1e74-42be-89b5-ede923ce83c7 with Priority: HIGHEST for action security_group_rules [ 1155.091602] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-606ca437-1e74-42be-89b5-ede923ce83c7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.091733] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.091792] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.092065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.092144] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('606ca437-1e74-42be-89b5-ede923ce83c7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.181666] env[66519]: INFO networking_nsxv3.common.synchronization [None req-ff29e62e-45b0-4c3d-8e07-cb4ab0d6b27c tempest-AttachVolumeNegativeTest-1001897465 tempest-AttachVolumeNegativeTest-1001897465-project-member] Enqueued Resource ID: 606ca437-1e74-42be-89b5-ede923ce83c7 with Priority: HIGHEST for action security_group_rules [ 1155.182331] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606ca437-1e74-42be-89b5-ede923ce83c7 with Priority: HIGHEST for action security_group_rules [ 1155.182660] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-606ca437-1e74-42be-89b5-ede923ce83c7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.182765] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.366298] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 811de0c5-86ee-4ef7-afc3-0946a87f0b2e: rpc.has_security_group_logging(os_id): False [ 1155.386309] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.386500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.386573] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.386784] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.386874] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.387114] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.387214] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.387356] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.387435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.387473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.388040] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.388040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.388040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.388855] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.389043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.389277] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.389410] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.389537] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.389656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.389732] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.389821] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1155.465213] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.465397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.465441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.465669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.465821] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.484421] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1155.614271] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.614468] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.614468] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.614683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.614788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.614885] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 606ca437-1e74-42be-89b5-ede923ce83c7 already deleted. [ 1155.614956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.615149] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.615311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.615394] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('606ca437-1e74-42be-89b5-ede923ce83c7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.137990] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.137990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.137990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.137990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.137990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.137990] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 606ca437-1e74-42be-89b5-ede923ce83c7 already deleted. [ 1156.137990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.700386] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: SUCCESS [ 1156.700503] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.700724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.700965] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.701196] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.701318] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.701377] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.701566] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.701654] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.701765] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.701872] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.204949] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.204949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.204949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.205419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.205419] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.205419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.205546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.205625] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.205696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.205783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.205935] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.206039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.206100] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.206279] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.206483] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.206618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.206711] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.206921] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.207096] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.207181] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.207223] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.502462] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1157.502724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.710963] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a5c9fd2-e0f8-469b-9019-610142582634: rpc.has_security_group_logging(os_id): False [ 1157.728815] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.728971] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.729056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.729271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.729366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.729643] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.729748] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.729811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.729966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.730056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.730251] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.730345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.730418] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.730540] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.730612] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.730800] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.730892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.730951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.731118] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.731192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.731275] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be updated. [ 1157.791805] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.791994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.792108] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.792315] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.792487] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.807958] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: IN_PROGRESS for 2s [ 1159.824982] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: SUCCESS [ 1159.825431] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.183079] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1160.183287] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1160.779722] env[66519]: INFO networking_nsxv3.common.synchronization [req-68ee5ce5-4c5e-4766-ab3c-a7aa04665923 req-cfc3e752-2be1-437d-806c-5d1a6ab21760 tempest-AttachVolumeNegativeTest-1001897465 tempest-AttachVolumeNegativeTest-1001897465-project-member] Enqueued Resource ID: 606ca437-1e74-42be-89b5-ede923ce83c7 with Priority: HIGHEST for action security_group_members [ 1160.780320] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606ca437-1e74-42be-89b5-ede923ce83c7 with Priority: HIGHEST for action security_group_members [ 1160.780702] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-606ca437-1e74-42be-89b5-ede923ce83c7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.780935] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.780935] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.781184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.781350] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.781514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.781514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.781623] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.781709] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.781859] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('606ca437-1e74-42be-89b5-ede923ce83c7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.093351] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-322 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.093673] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-322" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.093774] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-322" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.094049] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-322" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.094452] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.094635] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.094789] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.095066] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.095217] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.095418] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1161.095528] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1161.095632] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1161.095734] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1161.096146] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1161.096146] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1161.096280] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1161.117837] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1161.118021] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1161.118161] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1161.118341] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-322" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.118674] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-bed54115-5e68-426d-8205-0ac253de65a8 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.118837] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-bed54115-5e68-426d-8205-0ac253de65a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.118951] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-bed54115-5e68-426d-8205-0ac253de65a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.119394] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-bed54115-5e68-426d-8205-0ac253de65a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.119627] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bed54115-5e68-426d-8205-0ac253de65a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.284572] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.284780] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.284968] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.285724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.285724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.285724] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.285724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.285724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.285966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.285966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.285966] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 606ca437-1e74-42be-89b5-ede923ce83c7 already deleted. [ 1161.286066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.621868] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.622129] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.622255] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.622561] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.622788] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.622981] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port bed54115-5e68-426d-8205-0ac253de65a8 not found, creating... [ 1161.623329] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.623530] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.623588] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.623815] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.623947] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.624308] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.624479] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.624597] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.624875] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.625030] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.625200] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: bed54115-5e68-426d-8205-0ac253de65a8 is going to be created. [ 1161.646375] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.646600] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.646719] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.646993] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.647249] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.647518] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-bed54115-5e68-426d-8205-0ac253de65a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.357786] env[66519]: INFO networking_nsxv3.common.synchronization [req-68ee5ce5-4c5e-4766-ab3c-a7aa04665923 req-0554e5a1-80b4-4c07-bd5b-0e8f093363d3 service nova] Enqueued Resource ID: 606ca437-1e74-42be-89b5-ede923ce83c7 with Priority: HIGHEST for action security_group_rules [ 1162.358470] env[66519]: INFO networking_nsxv3.common.synchronization [req-68ee5ce5-4c5e-4766-ab3c-a7aa04665923 req-0554e5a1-80b4-4c07-bd5b-0e8f093363d3 service nova] Enqueued Resource ID: 606ca437-1e74-42be-89b5-ede923ce83c7 with Priority: HIGHEST for action security_group_members [ 1162.358470] env[66519]: INFO networking_nsxv3.common.synchronization [req-68ee5ce5-4c5e-4766-ab3c-a7aa04665923 req-0554e5a1-80b4-4c07-bd5b-0e8f093363d3 service nova] Enqueued Resource ID: bed54115-5e68-426d-8205-0ac253de65a8 with Priority: HIGHEST for action port [ 1162.358646] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606ca437-1e74-42be-89b5-ede923ce83c7 with Priority: HIGHEST for action security_group_rules [ 1162.358726] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606ca437-1e74-42be-89b5-ede923ce83c7 with Priority: HIGHEST for action security_group_members [ 1162.358845] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bed54115-5e68-426d-8205-0ac253de65a8 with Priority: HIGHEST for action port [ 1162.359240] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-606ca437-1e74-42be-89b5-ede923ce83c7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.359368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.359436] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.359682] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.359780] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('606ca437-1e74-42be-89b5-ede923ce83c7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.361049] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-606ca437-1e74-42be-89b5-ede923ce83c7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.361254] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.361345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.362257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.362470] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.362525] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.362574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.362754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.362846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.362939] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('606ca437-1e74-42be-89b5-ede923ce83c7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.363698] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-bed54115-5e68-426d-8205-0ac253de65a8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.363807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bed54115-5e68-426d-8205-0ac253de65a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.363857] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bed54115-5e68-426d-8205-0ac253de65a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.364022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bed54115-5e68-426d-8205-0ac253de65a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.364109] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bed54115-5e68-426d-8205-0ac253de65a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.431599] env[66519]: INFO networking_nsxv3.common.synchronization [req-fef53a10-323a-4b2a-b20e-44c5f65d829b req-bb9b2851-8640-4a2c-bd0d-a2d1059d0cbf tempest-DeleteServersTestJSON-1278201394 tempest-DeleteServersTestJSON-1278201394-project-member] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1162.431599] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1162.431845] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.431969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.432052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.432255] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.432406] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.432503] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.432563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.432703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.432787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.432876] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.862534] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-606ca437-1e74-42be-89b5-ede923ce83c7 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.862673] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.867140] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('606ca437-1e74-42be-89b5-ede923ce83c7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.868121] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bed54115-5e68-426d-8205-0ac253de65a8 with status ACTIVE [ 1162.868713] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.868713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.868713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.868713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.868947] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.868947] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.869066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.869102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.869243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.869306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.869546] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.869661] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.869699] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.869833] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.869915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.869984] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bed54115-5e68-426d-8205-0ac253de65a8 is going to be updated. [ 1162.894865] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.895028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.895111] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.895292] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.895421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.895589] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bed54115-5e68-426d-8205-0ac253de65a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.935099] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.935322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.935418] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.935717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.935849] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.936123] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.936276] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.936377] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.936686] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.936747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.936872] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1162.977803] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.977973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.978028] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.978243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.978384] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.990058] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1163.094278] env[66519]: INFO networking_nsxv3.common.synchronization [req-597792a5-2ab1-484d-bbb6-5098add914bb req-751379cd-8750-40c0-84af-aba513e7d4b2 tempest-ServerActionsTestOtherA-1261634680 tempest-ServerActionsTestOtherA-1261634680-project-member] Enqueued Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_members [ 1163.094834] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_members [ 1163.095212] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a766da37-b2e2-4b4b-a76f-5622297330c4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.095377] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.095466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.095717] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.095901] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.096033] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.096103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.096295] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.096384] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.096478] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.375045] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('606ca437-1e74-42be-89b5-ede923ce83c7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.388217] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-320 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.388217] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.388401] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.388585] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.388831] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.388982] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.389106] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.389315] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.389454] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.389802] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1163.389872] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1163.389966] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1163.390081] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1163.390188] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1163.390289] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1163.390413] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1163.410732] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1163.410873] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1163.411073] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1163.411295] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-320" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.411652] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-cc3da18b-207c-4b56-8538-1d59e935f3d9 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.411866] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-cc3da18b-207c-4b56-8538-1d59e935f3d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.411994] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-cc3da18b-207c-4b56-8538-1d59e935f3d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.412308] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-cc3da18b-207c-4b56-8538-1d59e935f3d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.412443] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc3da18b-207c-4b56-8538-1d59e935f3d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.598132] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.877430] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.877641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.877778] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.878055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.878156] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.878276] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 606ca437-1e74-42be-89b5-ede923ce83c7 is going to be created. [ 1163.902660] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.902832] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.902905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.903160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.903324] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.915043] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 606ca437-1e74-42be-89b5-ede923ce83c7 in Status: UNINITIALIZED for 2s [ 1163.917686] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.917940] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.918085] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.918352] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.918500] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.918648] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port cc3da18b-207c-4b56-8538-1d59e935f3d9 not found, creating... [ 1163.918897] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.919056] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.919173] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.919383] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.919567] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.919856] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.920015] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.920132] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.920332] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.920461] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.920680] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: cc3da18b-207c-4b56-8538-1d59e935f3d9 is going to be created. [ 1163.945798] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.946056] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.946193] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.946541] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.946825] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.947362] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-cc3da18b-207c-4b56-8538-1d59e935f3d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.993218] env[66519]: INFO networking_nsxv3.common.synchronization [req-0a55b6a0-e3a8-4d0d-b067-8cfc53a80dc1 req-1e6b3524-1e49-4781-b5e7-fbddc109d087 tempest-ServerActionsTestJSON-1487893254 tempest-ServerActionsTestJSON-1487893254-project-member] Enqueued Resource ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 with Priority: HIGHEST for action security_group_members [ 1163.993829] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 with Priority: HIGHEST for action security_group_members [ 1163.994184] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4ce9b9d-f478-407a-abb1-894afeb8d299 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.994184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.994324] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.994901] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.994901] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.994901] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.994901] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.994901] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.995142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.995142] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4ce9b9d-f478-407a-abb1-894afeb8d299',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.103916] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.499848] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.499848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.499848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.499848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.522040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.522040] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.522040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.522040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.522040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.522040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.522040] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 is going to be updated. [ 1164.550696] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.550696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.550696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.550696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.550696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.563647] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 in Status: IN_PROGRESS for 2s [ 1164.609627] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.609859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.609905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.610160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.610255] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.610466] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a766da37-b2e2-4b4b-a76f-5622297330c4 is going to be updated. [ 1164.643742] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.643962] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.643962] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.644237] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.644387] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.653944] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a766da37-b2e2-4b4b-a76f-5622297330c4 in Status: IN_PROGRESS for 2s [ 1164.664311] env[66519]: INFO networking_nsxv3.common.synchronization [req-597792a5-2ab1-484d-bbb6-5098add914bb req-20fc3103-14cc-4e44-b97f-fa7ce05e678f service nova] Enqueued Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_rules [ 1164.664494] env[66519]: INFO networking_nsxv3.common.synchronization [req-597792a5-2ab1-484d-bbb6-5098add914bb req-20fc3103-14cc-4e44-b97f-fa7ce05e678f service nova] Enqueued Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_members [ 1164.664627] env[66519]: INFO networking_nsxv3.common.synchronization [req-597792a5-2ab1-484d-bbb6-5098add914bb req-20fc3103-14cc-4e44-b97f-fa7ce05e678f service nova] Enqueued Resource ID: cc3da18b-207c-4b56-8538-1d59e935f3d9 with Priority: HIGHEST for action port [ 1164.665153] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_rules [ 1164.665290] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_members [ 1164.665424] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc3da18b-207c-4b56-8538-1d59e935f3d9 with Priority: HIGHEST for action port [ 1164.666757] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a766da37-b2e2-4b4b-a76f-5622297330c4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.666925] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.667035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.667273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.667427] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.668343] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a766da37-b2e2-4b4b-a76f-5622297330c4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.668448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.668664] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc3da18b-207c-4b56-8538-1d59e935f3d9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.668810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc3da18b-207c-4b56-8538-1d59e935f3d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.668873] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc3da18b-207c-4b56-8538-1d59e935f3d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.669086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc3da18b-207c-4b56-8538-1d59e935f3d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.669206] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc3da18b-207c-4b56-8538-1d59e935f3d9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.001255] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1165.001470] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e deletion is rescheduled due to dependency. [ 1165.001540] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.172082] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a766da37-b2e2-4b4b-a76f-5622297330c4 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.172249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.175669] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc3da18b-207c-4b56-8538-1d59e935f3d9 with status ACTIVE [ 1165.175869] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.176058] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.176127] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.176338] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.176424] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.176618] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.176685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.176752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.176889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.176966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.177152] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.177242] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.177301] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.177431] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.177554] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.177648] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc3da18b-207c-4b56-8538-1d59e935f3d9 is going to be updated. [ 1165.224808] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.225046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.225046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.225250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.225392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.225561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc3da18b-207c-4b56-8538-1d59e935f3d9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.925197] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 606ca437-1e74-42be-89b5-ede923ce83c7 in Status: SUCCESS [ 1165.925587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.925587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.925774] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.925976] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.926106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.926161] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.926316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.926398] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.926482] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.926572] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('606ca437-1e74-42be-89b5-ede923ce83c7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.429204] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('606ca437-1e74-42be-89b5-ede923ce83c7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.574666] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 in Status: SUCCESS [ 1166.574990] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 deletion is rescheduled due to dependency. [ 1166.575152] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.667855] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a766da37-b2e2-4b4b-a76f-5622297330c4 in Status: SUCCESS [ 1166.668091] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.668270] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.668495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.668686] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.668807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.668876] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.669026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.669110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.669204] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.934558] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 606ca437-1e74-42be-89b5-ede923ce83c7: rpc.has_security_group_logging(os_id): False [ 1166.952940] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.953173] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.953173] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.953384] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.953476] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.953721] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.953827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.953890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.954063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.954143] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.954254] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 606ca437-1e74-42be-89b5-ede923ce83c7 is going to be created. [ 1167.018900] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.019149] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.019149] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.019316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.019499] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.032935] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 606ca437-1e74-42be-89b5-ede923ce83c7 in Status: IN_PROGRESS for 2s [ 1167.172994] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.675181] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.177390] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.177838] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.177838] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.178014] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.178113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.178220] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a766da37-b2e2-4b4b-a76f-5622297330c4 is going to be updated. [ 1168.209967] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.210117] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.210253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.210407] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.210574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.221299] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a766da37-b2e2-4b4b-a76f-5622297330c4 in Status: IN_PROGRESS for 2s [ 1169.045263] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 606ca437-1e74-42be-89b5-ede923ce83c7 in Status: SUCCESS [ 1169.045500] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.061557] env[66519]: INFO networking_nsxv3.common.synchronization [req-825fc2a7-143a-430a-ae53-594aa733f90f req-2df586ab-a706-41cf-9da3-5a6c474a5411 tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_members [ 1169.061557] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_members [ 1169.061557] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-07045da6-f782-414e-a106-61339a5520a8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.061557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.061557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.061557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.061557] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.061557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.061557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.061557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.061957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.061957] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.564819] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.068085] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.232924] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a766da37-b2e2-4b4b-a76f-5622297330c4 in Status: IN_PROGRESS for 4s [ 1170.571603] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.572384] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.572384] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.572384] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.572384] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.572555] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07045da6-f782-414e-a106-61339a5520a8 is going to be updated. [ 1170.604633] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.604818] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.604863] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.605111] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.605256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.613585] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07045da6-f782-414e-a106-61339a5520a8 in Status: IN_PROGRESS for 2s [ 1172.266353] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a766da37-b2e2-4b4b-a76f-5622297330c4 in Status: SUCCESS [ 1172.266732] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.266772] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.267022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.267225] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.267363] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.267425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.267636] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.267702] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.267781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.267900] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.624453] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07045da6-f782-414e-a106-61339a5520a8 in Status: SUCCESS [ 1172.624705] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.770662] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.273446] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a766da37-b2e2-4b4b-a76f-5622297330c4: rpc.has_security_group_logging(os_id): False [ 1173.291954] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.292077] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.292150] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.292362] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.313889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.314249] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.314392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.314475] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.314691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.314777] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.314909] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a766da37-b2e2-4b4b-a76f-5622297330c4 is going to be updated. [ 1173.371749] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.372035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.372035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.372245] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.372374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.408847] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a766da37-b2e2-4b4b-a76f-5622297330c4 in Status: IN_PROGRESS for 2s [ 1174.061207] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1174.061422] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1175.426203] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a766da37-b2e2-4b4b-a76f-5622297330c4 in Status: SUCCESS [ 1175.426590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.579633] env[66519]: INFO networking_nsxv3.common.synchronization [req-c0a65be9-f531-420a-af24-c494d140f4dd req-ce037e15-ee42-4128-88ea-4ecaed3acde3 tempest-DeleteServersTestJSON-1278201394 tempest-DeleteServersTestJSON-1278201394-project-member] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1175.579633] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1175.579633] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.579633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.579633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.579633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.579633] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.579633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.579633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.579633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.579633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.579633] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.868294] env[66519]: INFO networking_nsxv3.common.synchronization [req-3982ba20-45df-4dff-a276-898e63130ea6 req-69e7d391-df59-4a36-995b-4005bfb3f975 tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_members [ 1175.868294] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07045da6-f782-414e-a106-61339a5520a8 with Priority: HIGHEST for action security_group_members [ 1175.868509] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-07045da6-f782-414e-a106-61339a5520a8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.869017] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.869017] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.869122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.869320] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.870071] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.870071] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.870071] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.870071] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.870071] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07045da6-f782-414e-a106-61339a5520a8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.960019] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-42 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.960019] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.960019] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.960019] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.960019] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.960019] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.960019] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.960019] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.960421] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.960737] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.960974] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1175.961190] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1175.961405] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1175.961603] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.962183] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1175.962520] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1175.985935] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1175.985935] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1175.985935] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1175.985935] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-42" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.985935] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-fc8f3793-26a3-45bb-858d-e5d6a673a9a0 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.985935] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-fc8f3793-26a3-45bb-858d-e5d6a673a9a0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.985935] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-fc8f3793-26a3-45bb-858d-e5d6a673a9a0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.985935] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-fc8f3793-26a3-45bb-858d-e5d6a673a9a0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.985935] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc8f3793-26a3-45bb-858d-e5d6a673a9a0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.085029] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.085248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.085248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.085457] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.085545] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.085743] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.085846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.085905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.086086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.086218] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.086313] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1176.115210] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.115368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.115368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.115576] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.115713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.124753] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1176.373251] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.373407] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.373490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.373712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.373805] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.374113] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.374184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.374217] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.374363] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.374448] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.374525] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07045da6-f782-414e-a106-61339a5520a8 is going to be updated. [ 1176.428385] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.428765] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.428765] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.428867] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.428951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.440697] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07045da6-f782-414e-a106-61339a5520a8 in Status: IN_PROGRESS for 2s [ 1176.487964] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.488220] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.488349] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.488727] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.488960] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.489151] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port fc8f3793-26a3-45bb-858d-e5d6a673a9a0 not found, creating... [ 1176.489429] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.489589] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.489876] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.490235] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.490402] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.490805] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.491034] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.491216] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.491646] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.491760] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.492017] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: fc8f3793-26a3-45bb-858d-e5d6a673a9a0 is going to be created. [ 1176.530139] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.530383] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.530468] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.530890] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.531173] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.531451] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-fc8f3793-26a3-45bb-858d-e5d6a673a9a0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.215021] env[66519]: INFO networking_nsxv3.common.synchronization [req-c0a65be9-f531-420a-af24-c494d140f4dd req-37b21517-ec4f-46d3-aa26-4b8a8d65a56f service nova] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_rules [ 1177.215021] env[66519]: INFO networking_nsxv3.common.synchronization [req-c0a65be9-f531-420a-af24-c494d140f4dd req-37b21517-ec4f-46d3-aa26-4b8a8d65a56f service nova] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1177.215021] env[66519]: INFO networking_nsxv3.common.synchronization [req-c0a65be9-f531-420a-af24-c494d140f4dd req-37b21517-ec4f-46d3-aa26-4b8a8d65a56f service nova] Enqueued Resource ID: fc8f3793-26a3-45bb-858d-e5d6a673a9a0 with Priority: HIGHEST for action port [ 1177.215021] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_rules [ 1177.215021] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1177.215452] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc8f3793-26a3-45bb-858d-e5d6a673a9a0 with Priority: HIGHEST for action port [ 1177.215809] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.215994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.216116] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.216441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.216604] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.220874] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.221097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.221353] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc8f3793-26a3-45bb-858d-e5d6a673a9a0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.222225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc8f3793-26a3-45bb-858d-e5d6a673a9a0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.222225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc8f3793-26a3-45bb-858d-e5d6a673a9a0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.222225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc8f3793-26a3-45bb-858d-e5d6a673a9a0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.222715] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc8f3793-26a3-45bb-858d-e5d6a673a9a0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.721019] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.721365] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.726585] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc8f3793-26a3-45bb-858d-e5d6a673a9a0 with status ACTIVE [ 1177.726801] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.726932] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.727013] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.727864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.727984] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.728198] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.728306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.728370] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.728530] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.728608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.728791] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.728926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.728989] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.729111] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.729174] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.729259] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc8f3793-26a3-45bb-858d-e5d6a673a9a0 is going to be updated. [ 1177.752247] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.752247] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.752463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.752584] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.753373] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.753373] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc8f3793-26a3-45bb-858d-e5d6a673a9a0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.136782] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1178.136952] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e deletion is rescheduled due to dependency. [ 1178.137082] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.137245] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.138607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.138607] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.138607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.138607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.138607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.138607] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.138607] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.379889] env[66519]: INFO networking_nsxv3.common.synchronization [req-b6df35a1-c099-4c77-8c38-2fb8ba07c2b9 req-325b0007-b54b-4ea7-9efd-b995d93bd8ac tempest-ServerActionsTestOtherB-865317477 tempest-ServerActionsTestOtherB-865317477-project-member] Enqueued Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 1178.380566] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 1178.380833] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.380927] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.381041] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.381269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.381445] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.381569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.381641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.381830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.381948] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.382140] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.451262] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07045da6-f782-414e-a106-61339a5520a8 in Status: SUCCESS [ 1178.451446] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07045da6-f782-414e-a106-61339a5520a8 deletion is rescheduled due to dependency. [ 1178.451565] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07045da6-f782-414e-a106-61339a5520a8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.640433] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.883944] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.884258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.884258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.884441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.906975] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.907255] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.907376] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.907444] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.907642] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.907771] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.907808] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee is going to be updated. [ 1178.944047] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.944047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.944047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.944047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.944047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.956008] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: IN_PROGRESS for 2s [ 1179.143328] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.646095] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.646273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.646346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.646560] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.646648] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.646780] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1179.681481] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.681712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.681822] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.682091] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.682680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.690790] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1180.967770] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: SUCCESS [ 1180.968267] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee deletion is rescheduled due to dependency. [ 1180.968267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.701044] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1181.701275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.701441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.701655] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.701852] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.701972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.702048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.702203] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.702284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.702368] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.702459] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.712793] env[66519]: INFO networking_nsxv3.common.synchronization [None req-411e9f87-77f6-4dcf-888f-2173bccb1a6f tempest-AttachInterfacesTestJSON-1131830450 tempest-AttachInterfacesTestJSON-1131830450-project-member] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1181.713136] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGHEST for action security_group_members [ 1181.713433] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.713552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.713618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.713810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.713993] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.714162] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.714208] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.714318] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.714397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.714484] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.205408] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.205814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.205814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.205894] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.206026] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.206133] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.206195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.206356] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.206441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.206528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.206677] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.206769] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.206829] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.206971] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.207124] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.207213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.207272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.207409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.207484] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.207563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.207650] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.216473] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.216624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.216667] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.216862] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.216953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.217165] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.217265] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.217327] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.217477] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.217551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.217637] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be updated. [ 1182.246078] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.246242] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.246298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.246518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.246656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.256285] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: IN_PROGRESS for 2s [ 1182.710462] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 811de0c5-86ee-4ef7-afc3-0946a87f0b2e: rpc.has_security_group_logging(os_id): False [ 1182.729986] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.730193] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.730258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.730435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.730535] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.730881] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.730993] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.731053] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.731234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.731346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.731553] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.731680] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.731775] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.731969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.732086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.732288] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.732388] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.732447] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.732590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.732664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.732749] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1182.802708] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.802897] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.802942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.803162] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.803314] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.819154] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1184.266399] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a5c9fd2-e0f8-469b-9019-610142582634 in Status: SUCCESS [ 1184.266399] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 deletion is rescheduled due to dependency. [ 1184.266399] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.840342] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1184.840660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.664178] env[66519]: INFO networking_nsxv3.common.synchronization [None req-96801b6e-e946-4ac4-a71f-edbf3c5c341c None None] Enqueued Resource ID: 97db3dde-6210-4880-bb93-07bb88ed63c8 with Priority: HIGHEST for action port [ 1186.664178] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97db3dde-6210-4880-bb93-07bb88ed63c8 with Priority: HIGHEST for action port [ 1186.664178] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-97db3dde-6210-4880-bb93-07bb88ed63c8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.664178] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97db3dde-6210-4880-bb93-07bb88ed63c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.664178] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97db3dde-6210-4880-bb93-07bb88ed63c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.664551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97db3dde-6210-4880-bb93-07bb88ed63c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.664551] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97db3dde-6210-4880-bb93-07bb88ed63c8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.166075] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97db3dde-6210-4880-bb93-07bb88ed63c8 [ 1187.166324] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.166459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.166528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.167177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.167177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.167177] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97db3dde-6210-4880-bb93-07bb88ed63c8 already deleted. [ 1187.167177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97db3dde-6210-4880-bb93-07bb88ed63c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.922224] env[66519]: INFO networking_nsxv3.common.synchronization [None req-df695371-1981-42bc-bf63-3a9f75869c20 None None] Enqueued Resource ID: 100ffbf1-3eb8-499b-8fa1-f8926f7899f8 with Priority: HIGHEST for action port [ 1188.924681] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 100ffbf1-3eb8-499b-8fa1-f8926f7899f8 with Priority: HIGHEST for action port [ 1188.925017] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-100ffbf1-3eb8-499b-8fa1-f8926f7899f8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.925148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-100ffbf1-3eb8-499b-8fa1-f8926f7899f8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.925219] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-100ffbf1-3eb8-499b-8fa1-f8926f7899f8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.925492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-100ffbf1-3eb8-499b-8fa1-f8926f7899f8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.925576] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('100ffbf1-3eb8-499b-8fa1-f8926f7899f8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.427525] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 100ffbf1-3eb8-499b-8fa1-f8926f7899f8 [ 1189.427813] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.427950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.428046] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.428271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.428364] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.428457] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:100ffbf1-3eb8-499b-8fa1-f8926f7899f8 already deleted. [ 1189.428557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-100ffbf1-3eb8-499b-8fa1-f8926f7899f8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.475680] env[66519]: INFO networking_nsxv3.common.synchronization [req-884e02b1-dc16-4ea9-aa3a-daec1b2082a0 req-6082d371-3a8d-4ee7-b28e-5a2fd8d8fc5c tempest-ServerActionsTestOtherB-865317477 tempest-ServerActionsTestOtherB-865317477-project-member] Enqueued Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 1191.476315] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 1191.476626] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.476747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.476814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.477022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.479161] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.479280] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.479348] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.479521] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.479608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.479700] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.773495] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-806 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.774235] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-806" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.774235] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-806" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.774914] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-806" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.775246] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.775417] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.775535] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.776093] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.776093] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.776225] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.776751] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1191.776751] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1191.776751] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1191.776751] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.776920] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1191.776952] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1191.809977] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1191.809977] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1191.810324] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1191.810487] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-806" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.811104] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-7e04a0fe-e738-4828-883e-6301c4ca5baf taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.811104] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-7e04a0fe-e738-4828-883e-6301c4ca5baf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.811104] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-7e04a0fe-e738-4828-883e-6301c4ca5baf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.811606] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-7e04a0fe-e738-4828-883e-6301c4ca5baf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.811606] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e04a0fe-e738-4828-883e-6301c4ca5baf',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.983065] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.986945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.986945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.986945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.986945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.986945] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.986945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.986945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.986945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.986945] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.986945] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee is going to be updated. [ 1192.030021] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.030287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.030287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.030546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.030606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.044149] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: IN_PROGRESS for 2s [ 1192.314757] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.315034] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.315034] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.315354] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.315552] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.315762] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 7e04a0fe-e738-4828-883e-6301c4ca5baf not found, creating... [ 1192.316100] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.316314] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.316454] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.316716] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.316892] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.317240] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.317453] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.317600] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.317866] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.318378] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.318378] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 7e04a0fe-e738-4828-883e-6301c4ca5baf is going to be created. [ 1192.384819] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.385336] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.385472] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.385747] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.385983] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.386244] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-7e04a0fe-e738-4828-883e-6301c4ca5baf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.542647] env[66519]: INFO networking_nsxv3.common.synchronization [req-884e02b1-dc16-4ea9-aa3a-daec1b2082a0 req-5089c2a5-e16d-4fd4-b40d-168906d15ae3 service nova] Enqueued Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_rules [ 1193.542950] env[66519]: INFO networking_nsxv3.common.synchronization [req-884e02b1-dc16-4ea9-aa3a-daec1b2082a0 req-5089c2a5-e16d-4fd4-b40d-168906d15ae3 service nova] Enqueued Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 1193.542950] env[66519]: INFO networking_nsxv3.common.synchronization [req-884e02b1-dc16-4ea9-aa3a-daec1b2082a0 req-5089c2a5-e16d-4fd4-b40d-168906d15ae3 service nova] Enqueued Resource ID: 7e04a0fe-e738-4828-883e-6301c4ca5baf with Priority: HIGHEST for action port [ 1193.543449] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_rules [ 1193.543583] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 1193.543694] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e04a0fe-e738-4828-883e-6301c4ca5baf with Priority: HIGHEST for action port [ 1193.543956] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.544088] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.544198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.544348] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.544430] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.545403] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.545403] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.545516] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e04a0fe-e738-4828-883e-6301c4ca5baf taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.545594] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e04a0fe-e738-4828-883e-6301c4ca5baf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.545656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e04a0fe-e738-4828-883e-6301c4ca5baf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.545813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e04a0fe-e738-4828-883e-6301c4ca5baf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.545888] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e04a0fe-e738-4828-883e-6301c4ca5baf',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.783906] env[66519]: INFO networking_nsxv3.common.synchronization [req-093ac7d8-04ab-4434-b2de-38830f3ca96b req-92133545-132d-4609-92d0-c30b238cf089 tempest-ServerDiskConfigTestJSON-286086519 tempest-ServerDiskConfigTestJSON-286086519-project-member] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1193.784676] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1193.784795] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.784920] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.785289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.785289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.785462] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.785604] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.785671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.785849] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.785950] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.786096] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.049428] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.049428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.053036] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e04a0fe-e738-4828-883e-6301c4ca5baf with status ACTIVE [ 1194.053036] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.053036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.053036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.053036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.053036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.053036] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.053036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.053036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.053036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.053036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.053036] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.053036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.053036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.053036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.053036] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.053036] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e04a0fe-e738-4828-883e-6301c4ca5baf is going to be updated. [ 1194.057623] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: SUCCESS [ 1194.057962] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee deletion is rescheduled due to dependency. [ 1194.058216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.058490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.060070] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.060070] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.060070] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.060070] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.060070] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.060070] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.060070] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.091619] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.091619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.091619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.091619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.091619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.091619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e04a0fe-e738-4828-883e-6301c4ca5baf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.132875] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-993 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.133447] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.133447] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.133619] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.133786] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.133931] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.134238] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.134485] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.134630] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.134832] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1194.134961] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1194.135098] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1194.135200] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1194.135306] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1194.135406] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1194.135530] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1194.165183] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1194.165376] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1194.165479] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1194.165655] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.166241] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-762297b4-a0ad-4a9f-ab6f-34bf0b5d97cf taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.166386] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-762297b4-a0ad-4a9f-ab6f-34bf0b5d97cf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.166386] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-762297b4-a0ad-4a9f-ab6f-34bf0b5d97cf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.166702] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-762297b4-a0ad-4a9f-ab6f-34bf0b5d97cf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.166836] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('762297b4-a0ad-4a9f-ab6f-34bf0b5d97cf',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.288993] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.289185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.289276] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.289714] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.290063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.290358] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.290486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.290553] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.290734] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.290813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.290911] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c already deleted. [ 1194.291031] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.562082] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.669215] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.669457] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.669585] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.669913] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.670076] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.670237] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 762297b4-a0ad-4a9f-ab6f-34bf0b5d97cf not found, creating... [ 1194.670508] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.670665] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.670783] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.671123] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.671187] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.671460] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.671615] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.671729] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.671923] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.672066] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.672211] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 762297b4-a0ad-4a9f-ab6f-34bf0b5d97cf is going to be created. [ 1194.692434] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.692700] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.692807] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.693111] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.693350] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.693586] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-762297b4-a0ad-4a9f-ab6f-34bf0b5d97cf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.063978] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.401421] env[66519]: INFO networking_nsxv3.common.synchronization [req-093ac7d8-04ab-4434-b2de-38830f3ca96b req-6ffa430f-0d9c-4f89-8d12-e451f0fdd697 service nova] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_rules [ 1195.401421] env[66519]: INFO networking_nsxv3.common.synchronization [req-093ac7d8-04ab-4434-b2de-38830f3ca96b req-6ffa430f-0d9c-4f89-8d12-e451f0fdd697 service nova] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1195.401421] env[66519]: INFO networking_nsxv3.common.synchronization [req-093ac7d8-04ab-4434-b2de-38830f3ca96b req-6ffa430f-0d9c-4f89-8d12-e451f0fdd697 service nova] Enqueued Resource ID: 762297b4-a0ad-4a9f-ab6f-34bf0b5d97cf with Priority: HIGHEST for action port [ 1195.401421] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_rules [ 1195.401421] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1195.401421] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 762297b4-a0ad-4a9f-ab6f-34bf0b5d97cf with Priority: HIGHEST for action port [ 1195.402339] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.402703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.402974] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.406029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.406029] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.406029] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.406029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.406029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.406029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.406029] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.406029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.406029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.409842] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.409842] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.409842] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.412841] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-762297b4-a0ad-4a9f-ab6f-34bf0b5d97cf taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.412841] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-762297b4-a0ad-4a9f-ab6f-34bf0b5d97cf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.412841] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-762297b4-a0ad-4a9f-ab6f-34bf0b5d97cf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.412841] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-762297b4-a0ad-4a9f-ab6f-34bf0b5d97cf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.412841] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('762297b4-a0ad-4a9f-ab6f-34bf0b5d97cf',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.566895] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.568374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.568374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.568374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.568374] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.568374] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee is going to be updated. [ 1195.603148] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.603366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.603474] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.603724] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.603910] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.612201] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: IN_PROGRESS for 2s [ 1195.915493] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.915625] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.915838] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.917247] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 762297b4-a0ad-4a9f-ab6f-34bf0b5d97cf with status ACTIVE [ 1195.917440] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.917550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.917616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.917865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.917934] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.918136] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.918239] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.918302] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.918453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.918529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.918955] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.918955] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.918955] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.919150] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.919150] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.919150] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 762297b4-a0ad-4a9f-ab6f-34bf0b5d97cf is going to be updated. [ 1195.943399] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.943615] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.943670] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.943916] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.944141] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.944350] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-762297b4-a0ad-4a9f-ab6f-34bf0b5d97cf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.418451] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.922090] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.922090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.922090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.922666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.922666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.922666] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be created. [ 1196.951123] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.951335] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.951335] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.951505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.951663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.961497] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: UNINITIALIZED for 2s [ 1197.622795] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: SUCCESS [ 1197.623030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.623206] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.623417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.623628] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.623746] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.623811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.623963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.624061] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.624146] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.624234] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.126708] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.629248] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7af6979-b772-40ee-bdb9-b29ca300beee: rpc.has_security_group_logging(os_id): False [ 1198.647164] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.647319] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.647391] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.647604] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.647695] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.647986] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.648125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.648125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.648273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.648349] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.648436] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee is going to be updated. [ 1198.707373] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.707550] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.707593] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.707779] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.707929] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.721415] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: IN_PROGRESS for 2s [ 1198.971576] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1198.971793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.971953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.972193] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.972524] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.972663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.972733] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.972905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.973084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.973184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.973277] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.476056] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.476353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.476353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.476574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.476752] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.476855] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.476918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.477086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.477169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.477256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.477402] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.477493] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.477552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.477691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.477828] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.477920] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.477981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.478152] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.478228] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.478312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.478402] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.984192] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b8cccb8-611f-4a20-9af8-d97d565c774c: rpc.has_security_group_logging(os_id): False [ 1200.004317] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.004507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.004547] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.004848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.004968] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.005240] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.005428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.005546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.005775] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.005919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.006202] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.006361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.006473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.006696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.006801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.007017] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.007129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.007195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.007390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.007480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.007606] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be created. [ 1200.085830] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.085830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.085830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.086217] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.086405] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.098599] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1200.401446] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1200.401651] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1200.736389] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: SUCCESS [ 1200.736707] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.381333] env[66519]: INFO networking_nsxv3.common.synchronization [req-dafe5e0d-1554-439d-ab74-8497dae87cf2 req-4fce8599-5c44-470b-9b3b-a20333982bc0 tempest-ServerActionsTestJSON-1487893254 tempest-ServerActionsTestJSON-1487893254-project-member] Enqueued Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_members [ 1201.381900] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_members [ 1201.382151] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.382283] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.382367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.382582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.382903] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.382903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.382903] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.383058] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.383111] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.383239] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.885523] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.886224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.886224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.886224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.925231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.925231] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.925231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.925231] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.925762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.925762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.926019] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb is going to be updated. [ 1201.965358] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.965599] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.965599] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.965770] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.965922] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.977306] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: IN_PROGRESS for 2s [ 1202.112563] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1202.112852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.987790] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: SUCCESS [ 1203.987790] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb deletion is rescheduled due to dependency. [ 1203.987790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.382745] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1206.383137] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1211.384280] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1211.384827] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1212.382599] env[66519]: INFO networking_nsxv3.common.synchronization [req-6d89dd25-9642-4644-b6a1-0b91898337c5 req-8998eb59-dd23-4ee8-ad03-1d9f51cb592f tempest-ServerActionsTestJSON-1487893254 tempest-ServerActionsTestJSON-1487893254-project-member] Enqueued Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_members [ 1212.383149] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_members [ 1212.383448] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.383567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.383633] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.383830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.383977] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.384086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.384148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.384325] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.384546] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.384546] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.673379] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.673527] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.673527] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.673840] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.674108] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.674266] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.674378] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.674589] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.674731] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.674933] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.675078] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1212.675206] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1212.675315] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1212.675427] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.675532] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1212.675660] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1212.696313] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1212.696490] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1212.696584] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1212.696752] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.697072] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-10529204-057f-40ea-ab11-55a32a263da8 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.697243] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-10529204-057f-40ea-ab11-55a32a263da8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.697387] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-10529204-057f-40ea-ab11-55a32a263da8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.697719] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-10529204-057f-40ea-ab11-55a32a263da8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.697854] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10529204-057f-40ea-ab11-55a32a263da8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.887260] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.887446] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.887518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.887760] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.887852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.888115] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.888214] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.888304] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.888431] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.888551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.888601] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb is going to be updated. [ 1212.915236] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.915490] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.915572] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.915807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.915976] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.925444] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: IN_PROGRESS for 2s [ 1213.200175] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.200486] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.200486] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.200742] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.200890] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.201057] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 10529204-057f-40ea-ab11-55a32a263da8 not found, creating... [ 1213.201323] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.201544] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.201671] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.201888] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.202032] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.202310] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.202487] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.202600] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.202800] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.202928] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.203073] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 10529204-057f-40ea-ab11-55a32a263da8 is going to be created. [ 1213.226673] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.226673] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.226673] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.226673] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.226673] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.226673] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-10529204-057f-40ea-ab11-55a32a263da8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.939603] env[66519]: INFO networking_nsxv3.common.synchronization [req-6d89dd25-9642-4644-b6a1-0b91898337c5 req-f11b4e4c-adf8-4926-a665-fa4e8e075649 service nova] Enqueued Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_rules [ 1213.939866] env[66519]: INFO networking_nsxv3.common.synchronization [req-6d89dd25-9642-4644-b6a1-0b91898337c5 req-f11b4e4c-adf8-4926-a665-fa4e8e075649 service nova] Enqueued Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_members [ 1213.939866] env[66519]: INFO networking_nsxv3.common.synchronization [req-6d89dd25-9642-4644-b6a1-0b91898337c5 req-f11b4e4c-adf8-4926-a665-fa4e8e075649 service nova] Enqueued Resource ID: 10529204-057f-40ea-ab11-55a32a263da8 with Priority: HIGHEST for action port [ 1213.940397] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_rules [ 1213.940530] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_members [ 1213.940627] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10529204-057f-40ea-ab11-55a32a263da8 with Priority: HIGHEST for action port [ 1213.940945] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.941035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.941223] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.941430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.941507] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.942786] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.943083] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.943213] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-10529204-057f-40ea-ab11-55a32a263da8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.943409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10529204-057f-40ea-ab11-55a32a263da8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.943409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10529204-057f-40ea-ab11-55a32a263da8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.943539] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10529204-057f-40ea-ab11-55a32a263da8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.943615] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10529204-057f-40ea-ab11-55a32a263da8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.444037] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.444262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.445527] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10529204-057f-40ea-ab11-55a32a263da8 with status ACTIVE [ 1214.445723] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.445855] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.445918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.446170] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.446313] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.446500] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.446609] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.446670] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.446833] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.446911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.447104] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.447199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.447259] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.447400] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.447473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.447556] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10529204-057f-40ea-ab11-55a32a263da8 is going to be updated. [ 1214.468661] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.468860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.468860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.469061] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.469197] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.469353] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10529204-057f-40ea-ab11-55a32a263da8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.935153] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: SUCCESS [ 1214.935340] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb deletion is rescheduled due to dependency. [ 1214.935451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.935602] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.935808] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.935987] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.936125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.936186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.936336] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.936425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.936517] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.438991] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.941458] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.445471] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.445800] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.445800] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.445913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.446013] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.446116] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb is going to be updated. [ 1216.484399] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.484613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.484613] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.485033] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.485033] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.494048] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: IN_PROGRESS for 2s [ 1218.508079] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: SUCCESS [ 1218.508412] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.508523] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.508845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.509158] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.509343] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.509455] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.509710] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.509857] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.510048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.510223] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.862118] env[66519]: INFO networking_nsxv3.common.synchronization [req-8df222ae-8286-4a87-a01f-c4b9bf93558f req-4bfb4e37-0184-4e13-83db-4759a7e23cc0 tempest-ServerDiskConfigTestJSON-286086519 tempest-ServerDiskConfigTestJSON-286086519-project-member] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1218.862772] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1218.863196] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.863361] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.863396] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.863614] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.863783] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.863926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.863984] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.864321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.864321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.864415] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.875397] env[66519]: INFO networking_nsxv3.common.synchronization [req-04c2fff9-99cc-4e9b-96f7-1d914294b6cf req-178be78d-e2f3-4a9b-96ef-38d21256146e tempest-DeleteServersTestJSON-1278201394 tempest-DeleteServersTestJSON-1278201394-project-member] Enqueued Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1218.876016] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e with Priority: HIGHEST for action security_group_members [ 1218.876431] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.876530] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.876679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.877125] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.877181] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.877276] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.877352] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.877538] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.877712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.877886] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('811de0c5-86ee-4ef7-afc3-0946a87f0b2e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.012610] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.367045] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.367249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.367302] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.367544] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.367664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.367867] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.367970] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.368041] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.368201] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.368275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.368371] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be updated. [ 1219.382438] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.382663] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.382713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.382931] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.383328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.383328] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.383479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.383479] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.383611] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.383686] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.383768] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e is going to be updated. [ 1219.401126] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.401355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.401428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.401641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.401780] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.410918] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1219.413263] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.413388] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.413462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.413657] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.413810] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.422190] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: IN_PROGRESS for 2s [ 1219.515040] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78ee5c7f-abf9-47ad-98da-200bfacc0aeb: rpc.has_security_group_logging(os_id): False [ 1219.533371] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.533582] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.533627] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.533832] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.533926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.534206] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.534321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.534386] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.534547] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.534624] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.534709] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb is going to be updated. [ 1219.592620] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.593213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.593213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.593473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.593512] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.607903] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: IN_PROGRESS for 2s [ 1220.460294] env[66519]: INFO networking_nsxv3.common.synchronization [req-884f2835-2857-4e57-a286-213d0e43acfa req-acc79414-cdfb-4fb3-a5fd-da1578b28576 tempest-ServerDiskConfigTestJSON-286086519 tempest-ServerDiskConfigTestJSON-286086519-project-member] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1220.460814] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1220.461731] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.461731] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.755755] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-993 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.756141] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.756141] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.756366] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.756627] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.756783] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.756900] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.757128] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.757273] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.757478] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1220.757592] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1220.757697] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1220.757802] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1220.757909] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1220.758018] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1220.758168] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1220.778727] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1220.778923] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1220.779018] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1220.779208] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.779548] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-8e8feaab-d2f5-4844-9d5e-c1923f9b5557 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.779779] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-8e8feaab-d2f5-4844-9d5e-c1923f9b5557" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.779903] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-8e8feaab-d2f5-4844-9d5e-c1923f9b5557" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.780283] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-8e8feaab-d2f5-4844-9d5e-c1923f9b5557" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.780423] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e8feaab-d2f5-4844-9d5e-c1923f9b5557',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.282560] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.282726] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.282860] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.283170] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.283318] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.283469] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 8e8feaab-d2f5-4844-9d5e-c1923f9b5557 not found, creating... [ 1221.283725] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.283880] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.283994] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.284306] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.284374] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.284640] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.284789] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.284902] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.285116] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.285251] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.285388] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 8e8feaab-d2f5-4844-9d5e-c1923f9b5557 is going to be created. [ 1221.307063] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.307439] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.307439] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.307679] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.307910] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.308185] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-8e8feaab-d2f5-4844-9d5e-c1923f9b5557" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.424593] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1221.424880] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c deletion is rescheduled due to dependency. [ 1221.425049] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.425228] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.425662] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.425930] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.426139] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.426242] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.426477] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.426616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.426762] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.436829] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e in Status: SUCCESS [ 1221.437044] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 811de0c5-86ee-4ef7-afc3-0946a87f0b2e deletion is rescheduled due to dependency. [ 1221.437180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-811de0c5-86ee-4ef7-afc3-0946a87f0b2e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.623291] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: SUCCESS [ 1221.623602] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.929156] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.929443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.929443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.929683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.929804] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.930049] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.930139] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.930244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.930467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.930572] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.930685] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be updated. [ 1221.958905] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.959060] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.959129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.959346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.959483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.968365] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1222.043262] env[66519]: INFO networking_nsxv3.common.synchronization [req-884f2835-2857-4e57-a286-213d0e43acfa req-992c8524-126b-4123-b962-a4908c71c097 service nova] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_rules [ 1222.043262] env[66519]: INFO networking_nsxv3.common.synchronization [req-884f2835-2857-4e57-a286-213d0e43acfa req-992c8524-126b-4123-b962-a4908c71c097 service nova] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1222.043262] env[66519]: INFO networking_nsxv3.common.synchronization [req-884f2835-2857-4e57-a286-213d0e43acfa req-992c8524-126b-4123-b962-a4908c71c097 service nova] Enqueued Resource ID: 8e8feaab-d2f5-4844-9d5e-c1923f9b5557 with Priority: HIGHEST for action port [ 1222.043588] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_rules [ 1222.044063] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1222.044237] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e8feaab-d2f5-4844-9d5e-c1923f9b5557 with Priority: HIGHEST for action port [ 1222.044788] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.045027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.045133] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.045389] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.045556] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.046731] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.046996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.047233] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e8feaab-d2f5-4844-9d5e-c1923f9b5557 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.047483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e8feaab-d2f5-4844-9d5e-c1923f9b5557" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.047793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e8feaab-d2f5-4844-9d5e-c1923f9b5557" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.047793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e8feaab-d2f5-4844-9d5e-c1923f9b5557" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.047906] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e8feaab-d2f5-4844-9d5e-c1923f9b5557',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.550738] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.550953] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.551295] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e8feaab-d2f5-4844-9d5e-c1923f9b5557 with status ACTIVE [ 1222.551583] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.551767] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.551854] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.552860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.552860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.552860] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.552860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.552860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.552860] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.553186] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.553186] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.553276] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.553276] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.553420] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.553545] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.553597] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e8feaab-d2f5-4844-9d5e-c1923f9b5557 is going to be updated. [ 1222.576587] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.576825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.576825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.577012] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.577152] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.577320] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e8feaab-d2f5-4844-9d5e-c1923f9b5557" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.978919] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1223.979322] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c deletion is rescheduled due to dependency. [ 1223.979322] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.979453] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.979626] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.979832] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.979960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.980040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.980253] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.980346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.980441] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.487776] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.990769] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.492778] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.493076] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.493205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.493560] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.493728] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.493869] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be updated. [ 1225.531445] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.531671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.531671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.531901] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.532626] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.543274] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1226.839344] env[66519]: INFO networking_nsxv3.common.synchronization [req-a2ae2a01-46ed-4602-a5a4-49b3420440b2 req-89e96755-aada-4d6c-8964-d27ba7147683 tempest-AttachVolumeNegativeTest-1001897465 tempest-AttachVolumeNegativeTest-1001897465-project-member] Enqueued Resource ID: 606ca437-1e74-42be-89b5-ede923ce83c7 with Priority: HIGHEST for action security_group_members [ 1226.839843] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606ca437-1e74-42be-89b5-ede923ce83c7 with Priority: HIGHEST for action security_group_members [ 1226.840185] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-606ca437-1e74-42be-89b5-ede923ce83c7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.840375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.840454] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.840790] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.840790] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.840913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.840997] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.841180] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.841269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.841386] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('606ca437-1e74-42be-89b5-ede923ce83c7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.347559] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.347877] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.347877] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.347998] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.348703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.348703] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.348703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.348703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.348703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.348703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.348919] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 606ca437-1e74-42be-89b5-ede923ce83c7 is going to be updated. [ 1227.379143] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.379143] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.379376] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.379458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.379572] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.391991] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 606ca437-1e74-42be-89b5-ede923ce83c7 in Status: IN_PROGRESS for 2s [ 1227.553118] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1227.553366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.553575] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.553801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.553992] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.554121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.554181] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.554335] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.554417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.554501] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.554594] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.057418] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.057674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.057674] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.057859] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.058252] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.058494] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.058632] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.058982] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.059152] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.059467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.059679] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.059825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.059825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.060278] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.060411] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.060960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.060960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.060960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.060960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.061507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.061507] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.563127] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b8cccb8-611f-4a20-9af8-d97d565c774c: rpc.has_security_group_logging(os_id): False [ 1228.588137] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.588357] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.588442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.588699] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.588811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.589063] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.589169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.589238] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.589419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.589513] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.589723] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.589823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.589885] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.590074] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.590170] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.590429] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.590518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.590638] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.590720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.590796] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.590881] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be updated. [ 1228.666806] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.666991] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.667049] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.667241] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.667429] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.680050] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1229.402457] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 606ca437-1e74-42be-89b5-ede923ce83c7 in Status: SUCCESS [ 1229.402848] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 606ca437-1e74-42be-89b5-ede923ce83c7 deletion is rescheduled due to dependency. [ 1229.402848] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.694821] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1230.695216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.818633] env[66519]: INFO networking_nsxv3.common.synchronization [None req-e96702f0-a33a-4d7b-98c3-6aee1df2c9ef tempest-AttachVolumeNegativeTest-1001897465 tempest-AttachVolumeNegativeTest-1001897465-project-member] Enqueued Resource ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f with Priority: HIGHEST for action security_group_rules [ 1231.819367] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f with Priority: HIGHEST for action security_group_rules [ 1231.819653] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e13aa80f-e1b7-4d45-817a-35e26b48df6f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.819865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.819913] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.820509] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.820622] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e13aa80f-e1b7-4d45-817a-35e26b48df6f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.909481] env[66519]: INFO networking_nsxv3.common.synchronization [None req-1edeb1cd-85b7-4ebe-8e29-5bf687b8da92 tempest-AttachVolumeNegativeTest-1001897465 tempest-AttachVolumeNegativeTest-1001897465-project-member] Enqueued Resource ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f with Priority: HIGHEST for action security_group_rules [ 1231.909959] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f with Priority: HIGHEST for action security_group_rules [ 1231.910400] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e13aa80f-e1b7-4d45-817a-35e26b48df6f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.910551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.346565] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.346781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.346781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.347014] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.347110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.347210] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f already deleted. [ 1232.347294] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.347445] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.347610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.347691] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e13aa80f-e1b7-4d45-817a-35e26b48df6f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.870163] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.870574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.870574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.870851] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.870991] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.871157] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f already deleted. [ 1232.871261] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.910880] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1236.911173] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1237.491774] env[66519]: INFO networking_nsxv3.common.synchronization [req-175722af-4920-4d74-bf45-906d1fe62519 req-b456c9dd-fd0a-4d31-83a8-4a5138bfe0be tempest-AttachVolumeNegativeTest-1001897465 tempest-AttachVolumeNegativeTest-1001897465-project-member] Enqueued Resource ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f with Priority: HIGHEST for action security_group_members [ 1237.491971] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f with Priority: HIGHEST for action security_group_members [ 1237.492334] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e13aa80f-e1b7-4d45-817a-35e26b48df6f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.492495] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.492570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.492830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.492990] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.493101] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.493165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.493314] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.493398] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.493491] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e13aa80f-e1b7-4d45-817a-35e26b48df6f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.844575] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-322 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.845446] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-322" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.845446] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-322" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.845446] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-322" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.845594] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.845660] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.845764] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.846018] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.846174] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.846398] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1237.846511] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1237.846630] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1237.846737] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1237.846857] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1237.846965] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1237.847127] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1237.868861] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1237.869294] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1237.869523] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1237.869704] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-322" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.870047] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-c4063737-3f19-468c-8142-e096e50fd5c0 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.870289] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-c4063737-3f19-468c-8142-e096e50fd5c0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.870499] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-c4063737-3f19-468c-8142-e096e50fd5c0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.870835] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-c4063737-3f19-468c-8142-e096e50fd5c0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.870970] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4063737-3f19-468c-8142-e096e50fd5c0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.996664] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.997110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.997110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.997208] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.997480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.997710] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.997811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.997879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.998109] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.998182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.998346] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f already deleted. [ 1237.998442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.373681] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.373938] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.374044] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.374340] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.374513] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.374691] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port c4063737-3f19-468c-8142-e096e50fd5c0 not found, creating... [ 1238.375031] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.375198] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.375315] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.375551] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.375687] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.375968] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.376136] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.376253] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.376458] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.376589] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.376787] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: c4063737-3f19-468c-8142-e096e50fd5c0 is going to be created. [ 1238.395954] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.396179] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.396270] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.396517] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.396729] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.396943] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-c4063737-3f19-468c-8142-e096e50fd5c0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.104146] env[66519]: INFO networking_nsxv3.common.synchronization [req-175722af-4920-4d74-bf45-906d1fe62519 req-2c9d0b1c-9672-470b-a2c8-d7de35feb029 service nova] Enqueued Resource ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f with Priority: HIGHEST for action security_group_rules [ 1239.104414] env[66519]: INFO networking_nsxv3.common.synchronization [req-175722af-4920-4d74-bf45-906d1fe62519 req-2c9d0b1c-9672-470b-a2c8-d7de35feb029 service nova] Enqueued Resource ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f with Priority: HIGHEST for action security_group_members [ 1239.104414] env[66519]: INFO networking_nsxv3.common.synchronization [req-175722af-4920-4d74-bf45-906d1fe62519 req-2c9d0b1c-9672-470b-a2c8-d7de35feb029 service nova] Enqueued Resource ID: c4063737-3f19-468c-8142-e096e50fd5c0 with Priority: HIGHEST for action port [ 1239.104915] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f with Priority: HIGHEST for action security_group_rules [ 1239.105068] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f with Priority: HIGHEST for action security_group_members [ 1239.105170] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4063737-3f19-468c-8142-e096e50fd5c0 with Priority: HIGHEST for action port [ 1239.105433] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e13aa80f-e1b7-4d45-817a-35e26b48df6f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.105559] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.105627] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.105884] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.105993] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e13aa80f-e1b7-4d45-817a-35e26b48df6f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.106820] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e13aa80f-e1b7-4d45-817a-35e26b48df6f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.108129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.108129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.108129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.108129] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.108129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.108129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.108129] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.108483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.108483] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e13aa80f-e1b7-4d45-817a-35e26b48df6f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.109014] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4063737-3f19-468c-8142-e096e50fd5c0 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.109196] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4063737-3f19-468c-8142-e096e50fd5c0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.109196] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4063737-3f19-468c-8142-e096e50fd5c0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.109340] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4063737-3f19-468c-8142-e096e50fd5c0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.109411] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4063737-3f19-468c-8142-e096e50fd5c0',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.484220] env[66519]: INFO networking_nsxv3.common.synchronization [req-3a28cdbf-3d7e-423e-9bd3-2f6ee22cf6d3 req-7b34a694-b6a7-442a-bd3b-0731fb19a4c0 tempest-ServerActionsTestOtherA-1261634680 tempest-ServerActionsTestOtherA-1261634680-project-member] Enqueued Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_members [ 1239.484824] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_members [ 1239.485168] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a766da37-b2e2-4b4b-a76f-5622297330c4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.485289] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.485347] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.485551] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.485708] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.485805] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.485863] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.486070] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.486171] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.486240] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.611777] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4063737-3f19-468c-8142-e096e50fd5c0 with status ACTIVE [ 1239.611777] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.611891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.611976] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.612199] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.612317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.612469] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.612579] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.612645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.613022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.613022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.613022] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.613215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.613215] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.613348] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.613384] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.614036] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4063737-3f19-468c-8142-e096e50fd5c0 is going to be updated. [ 1239.615195] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e13aa80f-e1b7-4d45-817a-35e26b48df6f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.616043] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e13aa80f-e1b7-4d45-817a-35e26b48df6f taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.616043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.637372] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.637549] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.637596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.638091] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.638091] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.638222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4063737-3f19-468c-8142-e096e50fd5c0" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.988659] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.116875] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e13aa80f-e1b7-4d45-817a-35e26b48df6f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.491233] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.621846] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.622053] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.622103] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.622311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.622656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.622656] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f is going to be created. [ 1240.647485] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.647702] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.647702] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.647979] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.648205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.658804] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f in Status: UNINITIALIZED for 2s [ 1240.993745] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.993958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.993958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.994210] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.994296] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.994395] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a766da37-b2e2-4b4b-a76f-5622297330c4 is going to be updated. [ 1241.024446] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.024693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.024693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.024866] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.025018] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.035107] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a766da37-b2e2-4b4b-a76f-5622297330c4 in Status: IN_PROGRESS for 2s [ 1242.668060] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f in Status: SUCCESS [ 1242.668060] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.668570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.668570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.668570] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.668697] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.668737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.668978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.669113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.669227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.669342] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e13aa80f-e1b7-4d45-817a-35e26b48df6f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.045986] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a766da37-b2e2-4b4b-a76f-5622297330c4 in Status: SUCCESS [ 1243.046223] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.171856] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e13aa80f-e1b7-4d45-817a-35e26b48df6f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.674411] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e13aa80f-e1b7-4d45-817a-35e26b48df6f: rpc.has_security_group_logging(os_id): False [ 1243.692907] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.693059] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.693181] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.693344] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.693432] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.693667] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.693768] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.693829] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.693977] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.694066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.694151] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f is going to be created. [ 1243.775513] env[66519]: INFO networking_nsxv3.common.synchronization [req-76101b0e-a358-4e3c-a704-d072ef1debe1 req-2bb2f4f9-201f-4dd7-af50-14ba81968b13 tempest-ServerDiskConfigTestJSON-286086519 tempest-ServerDiskConfigTestJSON-286086519-project-member] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1243.776079] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1243.776463] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.776564] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.776564] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.776865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.776928] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.776980] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.777185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.777422] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.777462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.777565] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.837410] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.837844] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.838014] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.838286] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.838618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.849955] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f in Status: IN_PROGRESS for 2s [ 1244.279692] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.279927] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.279927] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.280220] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.280339] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.280629] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.280739] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.280819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.280999] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.281113] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.281205] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be updated. [ 1244.319640] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.319883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.319964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.320294] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.320578] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.330088] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1245.862249] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f in Status: SUCCESS [ 1245.862538] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.340479] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1246.340648] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c deletion is rescheduled due to dependency. [ 1246.340909] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.476971] env[66519]: INFO networking_nsxv3.common.synchronization [req-5d64397c-93e4-4175-b5a3-7f4cae2c25f0 req-46e24924-fb27-4ca6-9448-f67ea8cd5be6 tempest-ServerDiskConfigTestJSON-286086519 tempest-ServerDiskConfigTestJSON-286086519-project-member] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1246.477527] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1246.477861] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.477985] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.478063] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.478263] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.478443] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.478556] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.478618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.478769] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.478854] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.478946] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.748925] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-993 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.748925] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.748925] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.749334] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.749530] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.749686] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.749797] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.750035] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.750177] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.750399] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1246.750559] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1246.750670] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1246.750777] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1246.750885] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1246.750985] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1246.751125] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1246.772363] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1246.772561] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1246.772637] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1246.772827] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.773161] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-8ac7ba64-fb5a-45c5-9238-05eeb1381db9 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.773330] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-8ac7ba64-fb5a-45c5-9238-05eeb1381db9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.773446] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-8ac7ba64-fb5a-45c5-9238-05eeb1381db9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.773776] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-8ac7ba64-fb5a-45c5-9238-05eeb1381db9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.773913] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ac7ba64-fb5a-45c5-9238-05eeb1381db9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.981338] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.981644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.981644] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.981822] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.981914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.982227] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.982326] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.982392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.982548] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.982626] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.982711] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be updated. [ 1247.019037] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.019266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.019440] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.019589] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.019754] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.037509] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1247.276100] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.276342] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.276342] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.276572] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.276720] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.276868] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 8ac7ba64-fb5a-45c5-9238-05eeb1381db9 not found, creating... [ 1247.277142] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.277296] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.277412] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.277621] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.277753] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.278029] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.278193] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.278294] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.278649] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.278918] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.279152] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 8ac7ba64-fb5a-45c5-9238-05eeb1381db9 is going to be created. [ 1247.309962] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.310243] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.310307] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.310657] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.310896] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.311159] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-8ac7ba64-fb5a-45c5-9238-05eeb1381db9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.494287] env[66519]: INFO networking_nsxv3.common.synchronization [req-5d64397c-93e4-4175-b5a3-7f4cae2c25f0 req-9af6fe7a-a3e5-4070-a8f7-b2ec1e200026 service nova] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_rules [ 1248.494684] env[66519]: INFO networking_nsxv3.common.synchronization [req-5d64397c-93e4-4175-b5a3-7f4cae2c25f0 req-9af6fe7a-a3e5-4070-a8f7-b2ec1e200026 service nova] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1248.494684] env[66519]: INFO networking_nsxv3.common.synchronization [req-5d64397c-93e4-4175-b5a3-7f4cae2c25f0 req-9af6fe7a-a3e5-4070-a8f7-b2ec1e200026 service nova] Enqueued Resource ID: 8ac7ba64-fb5a-45c5-9238-05eeb1381db9 with Priority: HIGHEST for action port [ 1248.495102] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_rules [ 1248.495237] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1248.495599] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ac7ba64-fb5a-45c5-9238-05eeb1381db9 with Priority: HIGHEST for action port [ 1248.495837] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.496449] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.496498] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.496668] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.496750] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.498363] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.498587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.498803] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ac7ba64-fb5a-45c5-9238-05eeb1381db9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.498907] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ac7ba64-fb5a-45c5-9238-05eeb1381db9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.498972] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ac7ba64-fb5a-45c5-9238-05eeb1381db9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.499155] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ac7ba64-fb5a-45c5-9238-05eeb1381db9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.499233] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ac7ba64-fb5a-45c5-9238-05eeb1381db9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.999159] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.999402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.002656] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8ac7ba64-fb5a-45c5-9238-05eeb1381db9 with status ACTIVE [ 1249.002919] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.003081] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.003160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.003365] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.003461] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.003640] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.003743] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.003813] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.003964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.004058] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.004243] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.004323] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.004389] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.004595] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.004664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.004739] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8ac7ba64-fb5a-45c5-9238-05eeb1381db9 is going to be updated. [ 1249.026865] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.027080] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.027080] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.027290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.027428] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.027590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ac7ba64-fb5a-45c5-9238-05eeb1381db9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.048643] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1249.048869] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c deletion is rescheduled due to dependency. [ 1249.049024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.049198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.049432] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.049623] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.049742] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.049948] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.050062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.050062] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.050151] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.552666] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.055521] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.557429] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.557902] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.557902] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.558042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.558042] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.558151] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be updated. [ 1250.591274] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.591567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.591567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.591723] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.591830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.604134] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1250.991872] env[66519]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1250.992072] env[66519]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-fd8bd764-12b8-4104-a8d7-d5f50595d214 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1252.641023] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1252.641383] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.641470] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.641748] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.641972] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.642158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.642234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.642401] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.642482] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.642570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.642662] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.144735] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.144958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.144958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.145148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.145323] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.145427] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.145485] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.145648] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.145737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.145841] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.145969] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.146075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.146133] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.146281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.146415] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.146507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.146557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.146730] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.146806] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.146886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.146983] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.496609] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1253.496609] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1253.649473] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b8cccb8-611f-4a20-9af8-d97d565c774c: rpc.has_security_group_logging(os_id): False [ 1253.666557] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.666713] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.666784] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.666991] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.667099] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.667316] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.667416] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.667478] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.667630] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.667706] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.667890] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.667982] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.668056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.668263] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.668340] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.668524] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.668619] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.668679] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.668815] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.668896] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.668980] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be updated. [ 1253.731207] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.731435] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.731564] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.731893] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.732110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.747955] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1255.767061] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1255.767451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.972099] env[66519]: INFO networking_nsxv3.common.synchronization [req-a3a2c668-cf7f-4c98-97fe-a78c36c1d2b2 req-c70f64a2-f683-4363-9704-44af30ee0d08 tempest-ServerActionsTestOtherA-1261634680 tempest-ServerActionsTestOtherA-1261634680-project-member] Enqueued Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_members [ 1255.972576] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGHEST for action security_group_members [ 1255.972896] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-a766da37-b2e2-4b4b-a76f-5622297330c4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.973213] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.973299] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.973522] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.973788] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.973788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.973788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.973996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.974058] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.974156] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.476674] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.476924] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.477032] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.477352] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.477504] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.477796] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.477963] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.478078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.478325] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.478443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.478616] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a766da37-b2e2-4b4b-a76f-5622297330c4 is going to be updated. [ 1256.506080] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.506312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.506312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.506548] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.506741] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.515721] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a766da37-b2e2-4b4b-a76f-5622297330c4 in Status: IN_PROGRESS for 2s [ 1258.527075] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a766da37-b2e2-4b4b-a76f-5622297330c4 in Status: SUCCESS [ 1258.527486] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a766da37-b2e2-4b4b-a76f-5622297330c4 deletion is rescheduled due to dependency. [ 1258.527486] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.973979] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1260.974362] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1263.945369] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.945766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.945766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.945869] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.946017] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.448840] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.950885] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.454503] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1265.454615] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1265.975509] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1265.975806] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1266.277756] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.277756] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.277756] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.278095] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.291089] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1266.291978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.292711] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1266.334384] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.334605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.334605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.334784] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.349144] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.350100] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1266.350210] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1266.350324] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1266.394390] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.394548] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.394618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.394828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.396090] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.396270] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1266.485267] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.485465] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.485504] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.485683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.486050] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.486618] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1266.564473] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.564699] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.564699] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.564893] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.565206] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.565493] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1266.565587] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'0a5c9fd2-e0f8-469b-9019-610142582634', '2713653c-36b0-489e-8ec3-6cae0694eead', 'e7af6979-b772-40ee-bdb9-b29ca300beee', '00e34dd9-4c15-4da5-b28c-ce12a509f41f', '78ee5c7f-abf9-47ad-98da-200bfacc0aeb', '1e8b7135-b92c-4b10-aa25-eb568bfe0ab7', 'cb1cadf6-d26e-4714-b83e-0fcbe235e2e5', '9b4e85b6-ed99-4ac0-9639-f46dc275381b', 'fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4', '606ca437-1e74-42be-89b5-ede923ce83c7', '60c13785-2872-4af9-91d3-148ba8f8cc39', 'a766da37-b2e2-4b4b-a76f-5622297330c4', '2ce59d72-8fa4-451a-bee1-2baec693136d', '0b8cccb8-611f-4a20-9af8-d97d565c774c', 'fed4f4c3-50a3-4a15-90e4-9a91623b80fa', 'c204b4b3-a1d5-4736-9d79-b4de3adce0c8', 'a51e17dc-f2f0-443a-9853-7cd6fa24da87', 'e4ce9b9d-f478-407a-abb1-894afeb8d299', 'bce1c878-084f-4aa4-935c-834b7a1e28f9', '820ceacd-99d3-4034-aaf8-315de338869a', 'facac47b-64fc-4659-9f54-1cb6066b4b88', 'e13aa80f-e1b7-4d45-817a-35e26b48df6f', '9ac79ffc-f04a-42fd-81ac-d6a0498a399f', '2b539ffb-57a2-420e-8eb3-8a80c9021bc6', 'bb3bbf89-6cbf-4b9e-b793-607035a2d9c3', '8806842e-05bb-42d4-891f-7827a3b60a33', '9619a08c-5035-47ce-91cf-089cdb9ae303', 'e0272502-d55a-4dab-9801-a7c27a17a4ef', 'c8a24d0e-87af-4465-ae43-ca9c589fc6b0', '6960f374-b898-4940-b626-d2d9b6819605', '07045da6-f782-414e-a106-61339a5520a8', '4090bc61-1cc1-4db7-9c78-0f0fabacd9aa', '8a189ee8-76c8-41eb-9042-b1c1fc45d147', '00c72ce6-74fa-4138-bcac-05408508b67c', '811de0c5-86ee-4ef7-afc3-0946a87f0b2e', 'ccd5db66-2de5-4ed6-9e0b-ddac0a31d6d9', 'c764bdd1-e51a-4d68-8351-c0fcec7cc0d1', '41789fc3-4591-4110-9aa7-18f52baf4691', 'fb0f115b-2ae8-4ea8-bf0a-99edddaaee58', '393aa0d3-c462-4737-b799-041054ed8323', 'fc90b596-5915-4a67-a6d8-a20bd8cf9e3c', '8e5e7bc4-c260-4f47-9e3e-5384e5bb5347', '376a7ea3-3e4d-4872-be2f-8bc029c25fac', 'a9ed5e58-fb42-4430-8674-e9d732009460'} {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1266.565684] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1266.586503] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.586703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.586703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.586871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.586959] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.587084] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1266.587153] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1266.587225] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1266.681702] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.681962] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.681962] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.682122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.683241] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.683494] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1266.683570] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66519) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1266.683642] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1266.683711] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1266.683788] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1266.683861] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGH for action security_group_rules [ 1266.683940] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGH for action security_group_rules [ 1266.684014] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGH for action security_group_rules [ 1266.684150] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f with Priority: HIGH for action security_group_rules [ 1266.684276] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGH for action security_group_rules [ 1266.684320] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGH for action security_group_rules [ 1266.684359] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGH for action security_group_rules [ 1266.684410] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGH for action security_group_rules [ 1266.684471] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGH for action security_group_rules [ 1266.684533] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 606ca437-1e74-42be-89b5-ede923ce83c7 with Priority: HIGH for action security_group_rules [ 1266.684594] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 with Priority: HIGH for action security_group_rules [ 1266.684660] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGH for action security_group_rules [ 1266.684744] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ce59d72-8fa4-451a-bee1-2baec693136d with Priority: HIGH for action security_group_rules [ 1266.684809] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGH for action security_group_rules [ 1266.684871] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa with Priority: HIGH for action security_group_rules [ 1266.684932] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 with Priority: HIGH for action security_group_rules [ 1266.684994] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 with Priority: HIGH for action security_group_rules [ 1266.685069] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 with Priority: HIGH for action security_group_rules [ 1266.685131] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 with Priority: HIGH for action security_group_rules [ 1266.685192] env[66519]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 820ceacd-99d3-4034-aaf8-315de338869a with Priority: HIGH for action security_group_rules [ 1266.685287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.977276] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1270.977631] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1270.977631] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a5c9fd2-e0f8-469b-9019-610142582634 with Priority: HIGH for action security_group_rules [ 1270.977631] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGH for action security_group_rules [ 1270.977754] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 with Priority: HIGH for action security_group_rules [ 1270.977819] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa with Priority: HIGH for action security_group_rules [ 1270.977915] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820ceacd-99d3-4034-aaf8-315de338869a with Priority: HIGH for action security_group_rules [ 1270.978023] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 with Priority: HIGH for action security_group_rules [ 1270.978117] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 with Priority: HIGH for action security_group_rules [ 1270.978227] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 with Priority: HIGH for action security_group_rules [ 1270.978331] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGH for action security_group_rules [ 1270.978433] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 with Priority: HIGH for action security_group_rules [ 1270.978526] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ce59d72-8fa4-451a-bee1-2baec693136d with Priority: HIGH for action security_group_rules [ 1270.978616] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a766da37-b2e2-4b4b-a76f-5622297330c4 with Priority: HIGH for action security_group_rules [ 1270.978720] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 with Priority: HIGH for action security_group_rules [ 1270.978834] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606ca437-1e74-42be-89b5-ede923ce83c7 with Priority: HIGH for action security_group_rules [ 1270.978924] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 with Priority: HIGH for action security_group_rules [ 1270.979018] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 with Priority: HIGH for action security_group_rules [ 1270.979109] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b with Priority: HIGH for action security_group_rules [ 1270.979197] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGH for action security_group_rules [ 1270.979281] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2713653c-36b0-489e-8ec3-6cae0694eead with Priority: HIGH for action security_group_rules [ 1270.979369] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f with Priority: HIGH for action security_group_rules [ 1270.979708] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a5c9fd2-e0f8-469b-9019-610142582634 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.979842] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.979904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.980162] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.980315] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a5c9fd2-e0f8-469b-9019-610142582634',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.981275] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.981388] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.981452] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.981889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.981970] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.982801] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.983812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.983812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.983812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.983812] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb1cadf6-d26e-4714-b83e-0fcbe235e2e5',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.984212] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.984212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.984212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.984212] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.984358] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fed4f4c3-50a3-4a15-90e4-9a91623b80fa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.984971] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-820ceacd-99d3-4034-aaf8-315de338869a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.985112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.985112] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.985242] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.985369] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('820ceacd-99d3-4034-aaf8-315de338869a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.986114] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bce1c878-084f-4aa4-935c-834b7a1e28f9 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.986114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.986114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.986489] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.986489] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bce1c878-084f-4aa4-935c-834b7a1e28f9',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.987221] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4ce9b9d-f478-407a-abb1-894afeb8d299 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.987221] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.987354] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.987388] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.987450] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4ce9b9d-f478-407a-abb1-894afeb8d299',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.988100] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a51e17dc-f2f0-443a-9853-7cd6fa24da87 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.988250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.988320] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.988409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.988478] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a51e17dc-f2f0-443a-9853-7cd6fa24da87',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.989160] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.989426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.989426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.989518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.989518] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.990300] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.990975] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.990975] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.990975] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.990975] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c204b4b3-a1d5-4736-9d79-b4de3adce0c8',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.991688] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ce59d72-8fa4-451a-bee1-2baec693136d taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.991796] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.991865] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.992020] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.992090] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ce59d72-8fa4-451a-bee1-2baec693136d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.992745] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a766da37-b2e2-4b4b-a76f-5622297330c4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.992850] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.992912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.993073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.993140] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a766da37-b2e2-4b4b-a76f-5622297330c4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.993790] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60c13785-2872-4af9-91d3-148ba8f8cc39 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.993905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.993955] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.994150] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.994428] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60c13785-2872-4af9-91d3-148ba8f8cc39',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.995096] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-606ca437-1e74-42be-89b5-ede923ce83c7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.995096] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.995096] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.995256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.995289] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('606ca437-1e74-42be-89b5-ede923ce83c7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.996027] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.996027] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.996179] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.996227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.996298] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.996936] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.997035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.997418] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.997418] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.997418] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1e8b7135-b92c-4b10-aa25-eb568bfe0ab7',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.998310] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.998310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.998310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.998458] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.998458] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b4e85b6-ed99-4ac0-9639-f46dc275381b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.999135] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.999243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.999312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.999767] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.999850] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.000643] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2713653c-36b0-489e-8ec3-6cae0694eead taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.000643] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.000802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.000883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.000932] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2713653c-36b0-489e-8ec3-6cae0694eead',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.001762] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00e34dd9-4c15-4da5-b28c-ce12a509f41f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.001762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.001905] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.002073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.002210] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00e34dd9-4c15-4da5-b28c-ce12a509f41f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.030385] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.030563] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.030630] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.030834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.058299] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.058454] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a5c9fd2-e0f8-469b-9019-610142582634 is going to be deleted. [ 1271.114270] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.114459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.114511] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.114709] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.114802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.114919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a5c9fd2-e0f8-469b-9019-610142582634" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.510817] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.510985] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.511048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.511234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.511394] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.511492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.511555] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.511705] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.511807] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.511892] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.511977] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.516675] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.516788] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.516856] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.517025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.517171] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.517267] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.517352] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.517461] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.517537] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.517618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.517698] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fed4f4c3-50a3-4a15-90e4-9a91623b80fa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.525109] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.525263] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.525317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.525460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.525609] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.525704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.525785] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.525911] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.526012] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.526167] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.526255] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.562343] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.562502] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.562547] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.562881] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.583237] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.583378] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.584163] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.584404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.584949] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.585056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.585742] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.585826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.586512] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.586605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.587812] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.587907] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.588861] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.588861] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.589350] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.589442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.590124] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.590220] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.590565] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.590651] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.591288] env[66519]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1271.591659] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.591752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.592505] env[66519]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1271.592796] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.592895] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.593510] env[66519]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1271.593917] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.594040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.594651] env[66519]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1271.595075] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.595328] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bce1c878-084f-4aa4-935c-834b7a1e28f9 is going to be deleted. [ 1271.596142] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.596365] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.599258] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.599367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.616492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.616649] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb1cadf6-d26e-4714-b83e-0fcbe235e2e5 is going to be deleted. [ 1271.617641] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.617914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.646005] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.646153] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 820ceacd-99d3-4034-aaf8-315de338869a is going to be deleted. [ 1271.647085] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.647294] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.664498] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.664669] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.669158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.669158] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c204b4b3-a1d5-4736-9d79-b4de3adce0c8 is going to be deleted. [ 1271.669604] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.669812] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.678833] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.679130] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.702516] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.702724] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00e34dd9-4c15-4da5-b28c-ce12a509f41f is going to be deleted. [ 1271.703645] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.703866] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.705802] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.705938] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.734419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.734629] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 606ca437-1e74-42be-89b5-ede923ce83c7 is going to be deleted. [ 1271.735695] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.735940] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.793102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.793283] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ce59d72-8fa4-451a-bee1-2baec693136d is going to be deleted. [ 1271.794181] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.794430] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.796675] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.796839] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.837359] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.837569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.867659] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.867889] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.880954] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.881192] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a766da37-b2e2-4b4b-a76f-5622297330c4 is going to be deleted. [ 1271.882121] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.882346] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.945728] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.945942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.946755] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.946869] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2713653c-36b0-489e-8ec3-6cae0694eead is going to be deleted. [ 1271.947798] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.948045] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.986264] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.986633] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1e8b7135-b92c-4b10-aa25-eb568bfe0ab7 is going to be deleted. [ 1271.987418] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.987636] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.022178] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fed4f4c3-50a3-4a15-90e4-9a91623b80fa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.024471] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.031643] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.031826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.031919] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.032248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.032431] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.032537] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.032601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.032759] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.032846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.032934] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.033099] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.033182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.033242] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.033381] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.033517] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.033608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.033664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.033800] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.033877] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.033958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.034062] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.037467] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.037589] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b4e85b6-ed99-4ac0-9639-f46dc275381b is going to be deleted. [ 1272.039043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.039043] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.083854] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.084087] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.105217] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.105392] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a51e17dc-f2f0-443a-9853-7cd6fa24da87 is going to be deleted. [ 1272.106324] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.106545] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.154218] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.154375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.160881] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.161073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.181064] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.181252] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60c13785-2872-4af9-91d3-148ba8f8cc39 is going to be deleted. [ 1272.182143] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.182357] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.254482] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.254704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.286567] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.286756] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4 is going to be deleted. [ 1272.287616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.287833] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.289212] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.289321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.290235] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.290328] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.388249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.388394] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee is going to be deleted. [ 1272.389373] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.389589] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.389683] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.390073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bce1c878-084f-4aa4-935c-834b7a1e28f9" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.390073] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.390195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.390224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.390327] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb1cadf6-d26e-4714-b83e-0fcbe235e2e5" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.390902] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.391079] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.391164] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.391298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-820ceacd-99d3-4034-aaf8-315de338869a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.391427] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.391863] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.391863] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.391863] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c204b4b3-a1d5-4736-9d79-b4de3adce0c8" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.391996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.392095] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.392172] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.392284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00e34dd9-4c15-4da5-b28c-ce12a509f41f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.392418] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.392561] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.392634] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.392749] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-606ca437-1e74-42be-89b5-ede923ce83c7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.392875] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.393019] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.393095] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.393203] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ce59d72-8fa4-451a-bee1-2baec693136d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.393340] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.393509] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.393584] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.393701] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a766da37-b2e2-4b4b-a76f-5622297330c4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.393827] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.393966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.394052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.394161] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2713653c-36b0-489e-8ec3-6cae0694eead" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.394285] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.394422] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.394494] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.394601] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1e8b7135-b92c-4b10-aa25-eb568bfe0ab7" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.394722] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.394894] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.395011] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.395137] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b4e85b6-ed99-4ac0-9639-f46dc275381b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.395264] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.395407] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.395507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.395651] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a51e17dc-f2f0-443a-9853-7cd6fa24da87" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.395783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.395926] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.395988] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.396114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60c13785-2872-4af9-91d3-148ba8f8cc39" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.424625] env[66519]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function GET Argumetns {'path': '/policy/api/v1/infra/domains/default/security-policies/default-layer3-logged-drop-section/rules', 'params': {'page_size': 200, 'cursor': ''}} Response=('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')): requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [ 1272.424822] env[66519]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Retrying connection (1/2) with timeout 2s for Client.get {{(pid=66519) decorator /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py:122}} [ 1272.454580] env[66519]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.455593] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.455593] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.455593] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.455840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.455840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.455899] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd3c31a2-0ae5-46a0-8dbf-bab0fc3f9de4" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.516727] env[66519]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.517560] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.517764] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.517853] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.518110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.518207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.518347] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.524803] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fed4f4c3-50a3-4a15-90e4-9a91623b80fa: rpc.has_security_group_logging(os_id): False [ 1272.526562] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78ee5c7f-abf9-47ad-98da-200bfacc0aeb: rpc.has_security_group_logging(os_id): False [ 1272.535467] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b8cccb8-611f-4a20-9af8-d97d565c774c: rpc.has_security_group_logging(os_id): False [ 1272.566797] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.567039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.567039] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.567238] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.577574] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.577762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.583768] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.583923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.610451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.610856] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.610981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.611035] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.611235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.611319] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.611581] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa is going to be updated. [ 1272.612578] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.612793] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.657596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.657682] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.657787] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.657856] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.658080] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.658162] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.658248] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb is going to be updated. [ 1272.659371] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.659552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.698606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.698988] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.699169] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.699234] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.699507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.699611] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.699922] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.700425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.700425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.700506] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.700570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.701194] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.701194] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.701290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.701491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.701614] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.701911] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be updated. [ 1272.729023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.729616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.729773] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.730083] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.730276] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.740144] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-806 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.740340] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-806" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.740461] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-806" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.740758] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-806" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.741028] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.741304] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.741304] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.741546] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.741715] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.741975] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1272.742103] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1272.742210] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1272.742322] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1272.742434] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1272.742537] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1272.742668] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1272.765441] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa in Status: IN_PROGRESS for 2s [ 1272.770506] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.770703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.770703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.770968] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.771139] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.775730] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1272.775893] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1272.776035] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1272.776212] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-806" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.776530] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-7e04a0fe-e738-4828-883e-6301c4ca5baf taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.776704] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-7e04a0fe-e738-4828-883e-6301c4ca5baf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.776822] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-7e04a0fe-e738-4828-883e-6301c4ca5baf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.777096] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-7e04a0fe-e738-4828-883e-6301c4ca5baf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.777232] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e04a0fe-e738-4828-883e-6301c4ca5baf',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.797704] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: IN_PROGRESS for 2s [ 1272.871165] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.871390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.871390] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.871595] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.871814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.906310] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1273.279984] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.280441] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.280441] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.280663] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.280892] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.281207] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.281369] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.281486] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.281915] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.281915] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.282142] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.282300] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.282415] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.282620] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.282750] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.282904] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 7e04a0fe-e738-4828-883e-6301c4ca5baf is going to be updated. [ 1273.312133] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.312356] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.312480] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.312814] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.313043] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.313303] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-7e04a0fe-e738-4828-883e-6301c4ca5baf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.970968] env[66519]: INFO networking_nsxv3.common.synchronization [req-0c936ae8-bcc4-470c-bc8e-5716e558d5b4 req-3feac6d2-48ba-47f0-93ae-2157af4d5d1e service nova] Enqueued Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_rules [ 1273.971156] env[66519]: INFO networking_nsxv3.common.synchronization [req-0c936ae8-bcc4-470c-bc8e-5716e558d5b4 req-3feac6d2-48ba-47f0-93ae-2157af4d5d1e service nova] Enqueued Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 1273.973658] env[66519]: INFO networking_nsxv3.common.synchronization [req-0c936ae8-bcc4-470c-bc8e-5716e558d5b4 req-3feac6d2-48ba-47f0-93ae-2157af4d5d1e service nova] Enqueued Resource ID: 7e04a0fe-e738-4828-883e-6301c4ca5baf with Priority: HIGHEST for action port [ 1273.973658] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_rules [ 1273.973658] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 1273.973658] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e04a0fe-e738-4828-883e-6301c4ca5baf with Priority: HIGHEST for action port [ 1273.973658] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.973658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.973658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.973658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.973658] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.974584] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.974584] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.974584] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.974584] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.974888] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.974888] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.974888] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.974888] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.975031] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.975063] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.975828] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e04a0fe-e738-4828-883e-6301c4ca5baf taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.975930] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e04a0fe-e738-4828-883e-6301c4ca5baf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.975991] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e04a0fe-e738-4828-883e-6301c4ca5baf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.977140] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e04a0fe-e738-4828-883e-6301c4ca5baf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.977233] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e04a0fe-e738-4828-883e-6301c4ca5baf',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.444219] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.444622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.444622] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.444689] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.464426] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.464651] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4ce9b9d-f478-407a-abb1-894afeb8d299 is going to be deleted. [ 1274.479369] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.480481] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.480618] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.481035] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7e04a0fe-e738-4828-883e-6301c4ca5baf with status ACTIVE [ 1274.481199] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.481311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.481371] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.481569] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.481657] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.481840] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.481915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.481987] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.482134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.482207] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.482381] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.482544] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.482544] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.482658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.482728] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.482810] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7e04a0fe-e738-4828-883e-6301c4ca5baf is going to be updated. [ 1274.503887] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.504105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.504105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.504330] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.504451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.504606] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e04a0fe-e738-4828-883e-6301c4ca5baf" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.519188] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.519376] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.519447] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.519653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.519758] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.519893] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4ce9b9d-f478-407a-abb1-894afeb8d299" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.781114] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa in Status: SUCCESS [ 1274.781364] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.820622] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: SUCCESS [ 1274.820856] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.921029] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1274.921298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.982150] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.485126] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.485536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.485536] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.485616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.485646] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.485828] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee is going to be updated. [ 1275.513360] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.513617] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.513617] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.513825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.513923] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.526755] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: IN_PROGRESS for 2s [ 1277.538479] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: SUCCESS [ 1277.538823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.538871] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.539128] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.539337] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.539459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.539525] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.539682] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.539764] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.539849] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.539939] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.042232] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.544693] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7af6979-b772-40ee-bdb9-b29ca300beee: rpc.has_security_group_logging(os_id): False [ 1278.563807] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.564157] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.564157] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.564360] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.564462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.565051] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.565051] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.565051] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.565460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.565460] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.565460] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee is going to be created. [ 1278.728120] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.728380] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.728380] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.728715] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.728918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.753144] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: IN_PROGRESS for 2s [ 1278.973316] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1278.973528] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1280.654699] env[66519]: INFO networking_nsxv3.common.synchronization [req-5fdb9bd6-355e-4514-80bc-efde67cfa383 req-236a5377-1afd-41a7-8f52-a1145e049389 tempest-AttachVolumeTestJSON-862216491 tempest-AttachVolumeTestJSON-862216491-project-member] Enqueued Resource ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa with Priority: HIGHEST for action security_group_members [ 1280.654869] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa with Priority: HIGHEST for action security_group_members [ 1280.655232] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.655392] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.655429] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.655599] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.657134] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.657134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.657134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.657134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.657441] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.657441] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fed4f4c3-50a3-4a15-90e4-9a91623b80fa',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.771195] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: SUCCESS [ 1280.771648] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.160509] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.160741] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.160828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.161145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.161273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.161534] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.161685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.161785] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.162033] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.162163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.162315] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa is going to be updated. [ 1281.197949] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.198192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.198192] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.198463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.198637] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.211166] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa in Status: IN_PROGRESS for 2s [ 1283.224749] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa in Status: SUCCESS [ 1283.225100] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fed4f4c3-50a3-4a15-90e4-9a91623b80fa deletion is rescheduled due to dependency. [ 1283.225100] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fed4f4c3-50a3-4a15-90e4-9a91623b80fa" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.656174] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1285.656503] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1285.745037] env[66519]: INFO networking_nsxv3.common.synchronization [None req-8e8a7187-e3a7-4c30-be2d-785a591a187f tempest-ServerDiskConfigTestJSON-286086519 tempest-ServerDiskConfigTestJSON-286086519-project-member] Enqueued Resource ID: e72c563a-2754-4984-9bbc-8673894d7c3b with Priority: HIGHEST for action security_group_rules [ 1285.745650] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e72c563a-2754-4984-9bbc-8673894d7c3b with Priority: HIGHEST for action security_group_rules [ 1285.745980] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e72c563a-2754-4984-9bbc-8673894d7c3b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.746126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e72c563a-2754-4984-9bbc-8673894d7c3b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.746185] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e72c563a-2754-4984-9bbc-8673894d7c3b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.746464] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e72c563a-2754-4984-9bbc-8673894d7c3b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.746620] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e72c563a-2754-4984-9bbc-8673894d7c3b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.863746] env[66519]: INFO networking_nsxv3.common.synchronization [None req-0706cce2-9973-42f8-ba88-6ef97d60a32c tempest-ServerDiskConfigTestJSON-286086519 tempest-ServerDiskConfigTestJSON-286086519-project-member] Enqueued Resource ID: e72c563a-2754-4984-9bbc-8673894d7c3b with Priority: HIGHEST for action security_group_rules [ 1285.864317] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e72c563a-2754-4984-9bbc-8673894d7c3b with Priority: HIGHEST for action security_group_rules [ 1285.864621] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e72c563a-2754-4984-9bbc-8673894d7c3b taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.864723] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e72c563a-2754-4984-9bbc-8673894d7c3b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.270350] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.270541] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.270588] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.270789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.270912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.271033] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e72c563a-2754-4984-9bbc-8673894d7c3b already deleted. [ 1286.271170] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e72c563a-2754-4984-9bbc-8673894d7c3b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.271298] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e72c563a-2754-4984-9bbc-8673894d7c3b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.271466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e72c563a-2754-4984-9bbc-8673894d7c3b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.271551] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e72c563a-2754-4984-9bbc-8673894d7c3b',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1286.795427] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.795745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.795745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.795957] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.796134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.796282] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e72c563a-2754-4984-9bbc-8673894d7c3b already deleted. [ 1286.796421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e72c563a-2754-4984-9bbc-8673894d7c3b" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.453423] env[66519]: INFO networking_nsxv3.common.synchronization [None req-cf146d0d-0d59-421c-9b7d-0d40266f62d6 tempest-AttachVolumeTestJSON-862216491 tempest-AttachVolumeTestJSON-862216491-project-member] Enqueued Resource ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 with Priority: HIGHEST for action security_group_rules [ 1287.453881] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 with Priority: HIGHEST for action security_group_rules [ 1287.454203] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.454327] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.454394] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.454647] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.454759] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('136ea30a-78ce-4fb9-9ed2-fbb65b2c7293',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.541022] env[66519]: INFO networking_nsxv3.common.synchronization [None req-14f8524b-00d6-45bb-bf74-365e47a10e0b tempest-AttachVolumeTestJSON-862216491 tempest-AttachVolumeTestJSON-862216491-project-member] Enqueued Resource ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 with Priority: HIGHEST for action security_group_rules [ 1287.541684] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 with Priority: HIGHEST for action security_group_rules [ 1287.542076] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.542189] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.974926] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.975262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.975262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.975419] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.975508] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.975604] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 already deleted. [ 1287.975684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.975914] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.976107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.976194] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('136ea30a-78ce-4fb9-9ed2-fbb65b2c7293',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.502055] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.502055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.502055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.502271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.502304] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.502383] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 already deleted. [ 1288.502463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.896832] env[66519]: INFO networking_nsxv3.common.synchronization [req-43fae24f-6330-46bf-897a-d930fe10106c req-03fbfdad-5056-44f6-bc73-c47883aa4736 tempest-ServerDiskConfigTestJSON-286086519 tempest-ServerDiskConfigTestJSON-286086519-project-member] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1288.897396] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1288.897700] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.897823] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.897883] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.898091] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.898242] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.898332] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.898393] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.898542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.898628] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.898719] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.401350] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.401745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.401745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.401745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.401745] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.402091] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.402251] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.402325] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.402488] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.402568] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.402655] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be updated. [ 1289.441296] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.441504] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.441566] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.441824] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.442040] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.454350] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1291.465593] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1291.466056] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c deletion is rescheduled due to dependency. [ 1291.466056] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.706852] env[66519]: INFO networking_nsxv3.common.synchronization [req-2299bc7c-e141-4d86-8ad7-7aa57319e298 req-e5ed1c51-951e-40ef-b99e-be03ed1a98a6 tempest-ServerActionsTestOtherB-865317477 tempest-ServerActionsTestOtherB-865317477-project-member] Enqueued Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 1291.706852] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7af6979-b772-40ee-bdb9-b29ca300beee with Priority: HIGHEST for action security_group_members [ 1291.706852] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7af6979-b772-40ee-bdb9-b29ca300beee taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.706852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.706852] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.708473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.708473] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.708473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.708473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.708473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.708473] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.708473] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7af6979-b772-40ee-bdb9-b29ca300beee',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.797248] env[66519]: INFO networking_nsxv3.common.synchronization [req-519e5343-4e92-404f-a21e-ae9ddaf1aec5 req-4dafeb6e-0f56-4016-9d0b-b345a97b8b2c tempest-ServerDiskConfigTestJSON-286086519 tempest-ServerDiskConfigTestJSON-286086519-project-member] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1291.797955] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1291.798608] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.798805] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.798944] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.799214] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.799461] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.799632] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.799740] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.799929] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.800030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.800131] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.134568] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-993 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.134898] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.135155] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.135544] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.135848] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.136078] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.136151] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.136324] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.136466] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.136675] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1292.136785] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1292.136889] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1292.136991] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1292.137111] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1292.137212] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1292.137341] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1292.159354] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1292.159538] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1292.159650] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1292.159823] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.160158] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-47dd6650-973e-49d3-b4b8-e78d62d5ffb3 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.160327] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-47dd6650-973e-49d3-b4b8-e78d62d5ffb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.160446] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-47dd6650-973e-49d3-b4b8-e78d62d5ffb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.160783] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-47dd6650-973e-49d3-b4b8-e78d62d5ffb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.160981] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47dd6650-973e-49d3-b4b8-e78d62d5ffb3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.210725] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.210725] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.210725] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.210996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.211114] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.211329] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.211408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.211470] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.211629] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.211703] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.211787] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee is going to be updated. [ 1292.240677] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.240677] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.240677] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.240677] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.240677] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.249998] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: IN_PROGRESS for 2s [ 1292.303025] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.303025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.303025] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.303309] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.303425] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.303712] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.303846] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.303912] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.304122] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.304209] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.304303] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be updated. [ 1292.337081] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.337266] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.337354] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.337597] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.337769] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.347914] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1292.663657] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.664082] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.664082] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.664318] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.664469] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.664621] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 47dd6650-973e-49d3-b4b8-e78d62d5ffb3 not found, creating... [ 1292.664890] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.665094] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.665215] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.665438] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.665573] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.666294] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.666471] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.666590] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.666799] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.666930] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.667083] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 47dd6650-973e-49d3-b4b8-e78d62d5ffb3 is going to be created. [ 1292.686634] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.686836] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.686956] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.687244] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.687466] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.687690] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-47dd6650-973e-49d3-b4b8-e78d62d5ffb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.425997] env[66519]: INFO networking_nsxv3.common.synchronization [req-519e5343-4e92-404f-a21e-ae9ddaf1aec5 req-9da8d39b-6658-4ea8-ac72-0c406472cf67 service nova] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_rules [ 1293.426255] env[66519]: INFO networking_nsxv3.common.synchronization [req-519e5343-4e92-404f-a21e-ae9ddaf1aec5 req-9da8d39b-6658-4ea8-ac72-0c406472cf67 service nova] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1293.426414] env[66519]: INFO networking_nsxv3.common.synchronization [req-519e5343-4e92-404f-a21e-ae9ddaf1aec5 req-9da8d39b-6658-4ea8-ac72-0c406472cf67 service nova] Enqueued Resource ID: 47dd6650-973e-49d3-b4b8-e78d62d5ffb3 with Priority: HIGHEST for action port [ 1293.427372] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_rules [ 1293.427547] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1293.427629] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47dd6650-973e-49d3-b4b8-e78d62d5ffb3 with Priority: HIGHEST for action port [ 1293.427926] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.428137] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.428190] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.428423] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.428548] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.430069] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.430069] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.430441] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-47dd6650-973e-49d3-b4b8-e78d62d5ffb3 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.430560] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47dd6650-973e-49d3-b4b8-e78d62d5ffb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.430629] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47dd6650-973e-49d3-b4b8-e78d62d5ffb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.430872] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47dd6650-973e-49d3-b4b8-e78d62d5ffb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.431078] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47dd6650-973e-49d3-b4b8-e78d62d5ffb3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.933175] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47dd6650-973e-49d3-b4b8-e78d62d5ffb3 with status ACTIVE [ 1293.933474] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.933899] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.933899] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.933899] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.934021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.934238] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.934348] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.934429] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.934599] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.934690] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.934956] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.935251] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.935251] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.935354] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.935420] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.935496] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47dd6650-973e-49d3-b4b8-e78d62d5ffb3 is going to be updated. [ 1293.936682] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.936771] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.959230] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.959230] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.959230] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.959230] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.959230] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.959230] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47dd6650-973e-49d3-b4b8-e78d62d5ffb3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.021977] env[66519]: INFO networking_nsxv3.common.synchronization [req-a57c7fb9-0add-400b-83dc-4cee52224f77 req-2cefc112-49a4-41ed-9eef-665324ddc77b tempest-AttachVolumeTestJSON-862216491 tempest-AttachVolumeTestJSON-862216491-project-member] Enqueued Resource ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 with Priority: HIGHEST for action security_group_members [ 1294.021977] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 with Priority: HIGHEST for action security_group_members [ 1294.022420] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.022608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.022716] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.023124] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.023434] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.023587] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.023639] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.023885] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.024066] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.024226] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('136ea30a-78ce-4fb9-9ed2-fbb65b2c7293',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.259759] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7af6979-b772-40ee-bdb9-b29ca300beee in Status: SUCCESS [ 1294.259998] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7af6979-b772-40ee-bdb9-b29ca300beee deletion is rescheduled due to dependency. [ 1294.260165] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7af6979-b772-40ee-bdb9-b29ca300beee" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.334641] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-17 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.334848] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-17" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.334974] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-17" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.335290] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-17" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.335555] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.335709] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.335822] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.336049] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.336192] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.336395] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1294.336503] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1294.336605] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1294.336705] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1294.336808] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1294.336909] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1294.337046] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1294.365941] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1294.366262] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c deletion is rescheduled due to dependency. [ 1294.366262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.366466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.366695] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.366882] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.367021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.367084] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.367248] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.367341] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.367437] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.369699] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1294.369699] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1294.369914] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1294.370066] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-17" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.370479] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-e0760465-f2a9-4a89-b82c-bac2a0996a1e taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.370740] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-e0760465-f2a9-4a89-b82c-bac2a0996a1e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.370977] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-e0760465-f2a9-4a89-b82c-bac2a0996a1e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.371340] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-e0760465-f2a9-4a89-b82c-bac2a0996a1e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.371480] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0760465-f2a9-4a89-b82c-bac2a0996a1e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.527428] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.527590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.527664] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.527884] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.527979] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.528192] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.528310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.528367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.528526] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.528628] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.528683] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 already deleted. [ 1294.528753] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.873835] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.875495] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.875691] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.875813] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.876104] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.877295] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.877295] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port e0760465-f2a9-4a89-b82c-bac2a0996a1e not found, creating... [ 1294.877295] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.877295] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.877295] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.877295] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.877821] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.877821] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.877821] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.878070] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.878132] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.878290] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.878434] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: e0760465-f2a9-4a89-b82c-bac2a0996a1e is going to be created. [ 1294.898366] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.898584] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.898689] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.898961] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.899200] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.899420] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-e0760465-f2a9-4a89-b82c-bac2a0996a1e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.380888] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.609455] env[66519]: INFO networking_nsxv3.common.synchronization [req-a57c7fb9-0add-400b-83dc-4cee52224f77 req-1901ef74-b74a-472e-9fbc-a3803af5417c service nova] Enqueued Resource ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 with Priority: HIGHEST for action security_group_rules [ 1295.609673] env[66519]: INFO networking_nsxv3.common.synchronization [req-a57c7fb9-0add-400b-83dc-4cee52224f77 req-1901ef74-b74a-472e-9fbc-a3803af5417c service nova] Enqueued Resource ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 with Priority: HIGHEST for action security_group_members [ 1295.609898] env[66519]: INFO networking_nsxv3.common.synchronization [req-a57c7fb9-0add-400b-83dc-4cee52224f77 req-1901ef74-b74a-472e-9fbc-a3803af5417c service nova] Enqueued Resource ID: e0760465-f2a9-4a89-b82c-bac2a0996a1e with Priority: HIGHEST for action port [ 1295.610511] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 with Priority: HIGHEST for action security_group_rules [ 1295.610715] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 with Priority: HIGHEST for action security_group_members [ 1295.610833] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0760465-f2a9-4a89-b82c-bac2a0996a1e with Priority: HIGHEST for action port [ 1295.611045] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.611177] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.611250] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.611459] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.611544] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('136ea30a-78ce-4fb9-9ed2-fbb65b2c7293',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.613365] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.613365] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.613365] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.613365] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.613365] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.613365] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.613747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.613747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.613747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.614019] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('136ea30a-78ce-4fb9-9ed2-fbb65b2c7293',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.614560] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0760465-f2a9-4a89-b82c-bac2a0996a1e taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.614660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0760465-f2a9-4a89-b82c-bac2a0996a1e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.614729] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0760465-f2a9-4a89-b82c-bac2a0996a1e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.614879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0760465-f2a9-4a89-b82c-bac2a0996a1e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.614971] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0760465-f2a9-4a89-b82c-bac2a0996a1e',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.885699] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.885879] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.885955] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.886184] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.886275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.886370] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be updated. [ 1295.914206] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.914369] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.914505] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.914720] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.914863] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.923397] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1296.117392] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('136ea30a-78ce-4fb9-9ed2-fbb65b2c7293',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.118545] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.118696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.118893] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0760465-f2a9-4a89-b82c-bac2a0996a1e with status ACTIVE [ 1296.119141] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.119293] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.119366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.119581] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.119658] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.119828] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.119925] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.119986] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.120152] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.120335] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.120562] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.120693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.120775] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.120943] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.121078] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.121189] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0760465-f2a9-4a89-b82c-bac2a0996a1e is going to be updated. [ 1296.143670] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.143814] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.143886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.144102] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.144243] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.144402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0760465-f2a9-4a89-b82c-bac2a0996a1e" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.623449] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('136ea30a-78ce-4fb9-9ed2-fbb65b2c7293',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.126739] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.127118] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.127320] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.127672] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.127850] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.128075] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 is going to be created. [ 1297.154846] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.155097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.155225] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.155544] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.155768] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.167280] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 in Status: UNINITIALIZED for 2s [ 1297.936022] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1297.936022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.936022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.936022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.936022] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.936022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.936022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.936022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.936022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.936022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.936022] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.438624] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.438811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.438922] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.439182] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.439378] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.439492] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.439570] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.440175] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.440290] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.440396] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.440567] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.440685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.440757] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.440927] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.441193] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.441310] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.441380] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.441552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.441738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.441738] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.441834] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.540109] env[66519]: INFO networking_nsxv3.common.synchronization [req-2bb35ee9-f221-4da2-aa9e-abea9091b86c req-1883239c-02cb-4671-89f9-13bbb8241107 tempest-ServerActionsTestJSON-1487893254 tempest-ServerActionsTestJSON-1487893254-project-member] Enqueued Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_members [ 1298.540800] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_members [ 1298.541600] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.541757] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.541843] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.542132] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.542369] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.542496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.542596] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.542816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.542930] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.543028] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.944928] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b8cccb8-611f-4a20-9af8-d97d565c774c: rpc.has_security_group_logging(os_id): False [ 1298.964847] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.965048] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.965127] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.965404] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.965530] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.965793] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.965941] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.966019] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.966224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.966345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.966669] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.966769] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.966769] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.966949] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.967082] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.967306] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.967421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.967491] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.967660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.967802] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.967887] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be updated. [ 1299.036524] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.036747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.036747] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.036934] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.037026] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.045933] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.046737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.046737] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.046954] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.047024] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.047342] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.047512] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.047621] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.047898] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.048011] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.048167] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb is going to be updated. [ 1299.051650] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1299.076632] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.076845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.076901] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.077195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.077345] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.086590] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: IN_PROGRESS for 2s [ 1299.184105] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 in Status: SUCCESS [ 1299.184349] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.184534] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.184801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.185039] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.185166] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.185232] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.185389] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.185469] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.185556] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.185683] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('136ea30a-78ce-4fb9-9ed2-fbb65b2c7293',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.687867] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('136ea30a-78ce-4fb9-9ed2-fbb65b2c7293',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.190476] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293: rpc.has_security_group_logging(os_id): False [ 1300.210606] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.210796] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.210842] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.211528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.211528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.211528] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.211731] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.211731] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.211826] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.211890] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.212098] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 is going to be created. [ 1300.275023] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.275023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.275023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.275023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.275023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.290761] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 in Status: IN_PROGRESS for 2s [ 1301.086728] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1301.088034] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.097470] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: SUCCESS [ 1301.097743] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb deletion is rescheduled due to dependency. [ 1301.097743] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.303306] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 in Status: SUCCESS [ 1302.303700] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.541465] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1303.541938] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1303.956479] env[66519]: INFO networking_nsxv3.common.synchronization [req-f528d6cf-584a-4e95-bfe2-dbca0c160187 req-cf59aff1-01e6-4ec7-8660-a2611a9c81d1 tempest-AttachVolumeNegativeTest-1001897465 tempest-AttachVolumeNegativeTest-1001897465-project-member] Enqueued Resource ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f with Priority: HIGHEST for action security_group_members [ 1303.956744] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f with Priority: HIGHEST for action security_group_members [ 1303.957128] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-e13aa80f-e1b7-4d45-817a-35e26b48df6f taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.957408] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.957520] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.957756] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.957956] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.958093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.958160] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.958355] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.958446] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.958545] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e13aa80f-e1b7-4d45-817a-35e26b48df6f',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.460811] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.461068] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.461126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.461442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.483110] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.483426] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.483578] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.483666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.483904] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.483996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.484104] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f is going to be updated. [ 1304.510951] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.511217] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.511306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.511518] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.511660] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.521801] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f in Status: IN_PROGRESS for 2s [ 1306.533729] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f in Status: SUCCESS [ 1306.534168] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e13aa80f-e1b7-4d45-817a-35e26b48df6f deletion is rescheduled due to dependency. [ 1306.534247] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e13aa80f-e1b7-4d45-817a-35e26b48df6f" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.532461] env[66519]: INFO networking_nsxv3.common.synchronization [req-af273f90-cdaf-4b6d-86d3-09886f72caa6 req-1b413f4b-5be5-415e-9d4b-2de76790dd71 tempest-ServerActionsTestJSON-1487893254 tempest-ServerActionsTestJSON-1487893254-project-member] Enqueued Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_members [ 1307.533022] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_members [ 1307.533344] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.533471] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.533539] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.533733] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.533895] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.534132] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.534132] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.534249] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.534297] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.534387] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.853925] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.854157] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.854291] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.854549] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.854806] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.854959] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.855088] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.855298] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.855438] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.855645] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1307.855756] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1307.855859] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1307.855963] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1307.856082] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1307.856187] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1307.856338] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1307.876190] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1307.876373] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1307.876521] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1307.876764] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-647" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.877107] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-cfb3c12a-4737-42a2-82be-9344ab73e304 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.877300] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-cfb3c12a-4737-42a2-82be-9344ab73e304" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.877422] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-cfb3c12a-4737-42a2-82be-9344ab73e304" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.877734] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-cfb3c12a-4737-42a2-82be-9344ab73e304" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.877870] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfb3c12a-4737-42a2-82be-9344ab73e304',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.036840] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.037133] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.037133] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.037244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.037334] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.037533] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.037636] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.037693] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.037857] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.037932] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.038033] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb is going to be updated. [ 1308.062870] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.063106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.063106] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.063308] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.063489] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.072970] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: IN_PROGRESS for 2s [ 1308.380507] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.380750] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.380877] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.381285] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.381422] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.381589] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port cfb3c12a-4737-42a2-82be-9344ab73e304 not found, creating... [ 1308.381862] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.382082] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.382281] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.382539] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.382691] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.382997] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.383173] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.383289] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.383517] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.383642] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.383780] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: cfb3c12a-4737-42a2-82be-9344ab73e304 is going to be created. [ 1308.404760] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.404979] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.405101] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.405377] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.405615] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.405835] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-cfb3c12a-4737-42a2-82be-9344ab73e304" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.114562] env[66519]: INFO networking_nsxv3.common.synchronization [req-af273f90-cdaf-4b6d-86d3-09886f72caa6 req-98fcb4a3-9caf-43ed-93fa-3ebf392cb8f5 service nova] Enqueued Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_rules [ 1309.114818] env[66519]: INFO networking_nsxv3.common.synchronization [req-af273f90-cdaf-4b6d-86d3-09886f72caa6 req-98fcb4a3-9caf-43ed-93fa-3ebf392cb8f5 service nova] Enqueued Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_members [ 1309.114917] env[66519]: INFO networking_nsxv3.common.synchronization [req-af273f90-cdaf-4b6d-86d3-09886f72caa6 req-98fcb4a3-9caf-43ed-93fa-3ebf392cb8f5 service nova] Enqueued Resource ID: cfb3c12a-4737-42a2-82be-9344ab73e304 with Priority: HIGHEST for action port [ 1309.115415] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_rules [ 1309.115551] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_members [ 1309.115686] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfb3c12a-4737-42a2-82be-9344ab73e304 with Priority: HIGHEST for action port [ 1309.115959] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.116093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.116198] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.116351] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.116429] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.117293] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.117385] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.117628] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfb3c12a-4737-42a2-82be-9344ab73e304 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.117728] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfb3c12a-4737-42a2-82be-9344ab73e304" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.117794] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfb3c12a-4737-42a2-82be-9344ab73e304" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.117958] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfb3c12a-4737-42a2-82be-9344ab73e304" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.118045] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfb3c12a-4737-42a2-82be-9344ab73e304',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.619864] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.619864] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.623085] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cfb3c12a-4737-42a2-82be-9344ab73e304 with status ACTIVE [ 1309.623085] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.623085] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.623085] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.623523] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.623523] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.623523] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.623686] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.623770] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.623942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.624033] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.624261] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.624384] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.624513] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.624681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.624805] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.624954] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cfb3c12a-4737-42a2-82be-9344ab73e304 is going to be updated. [ 1309.648858] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.649687] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.649789] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.650030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.650158] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.650321] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfb3c12a-4737-42a2-82be-9344ab73e304" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.084554] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: SUCCESS [ 1310.084814] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb deletion is rescheduled due to dependency. [ 1310.084886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.085022] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.085244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.085431] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.085552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.085608] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.085760] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.085840] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.085946] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.588126] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.090948] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.593390] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.593828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.593828] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.593900] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.593930] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.594043] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb is going to be updated. [ 1311.657072] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.657072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.657072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.657072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.657072] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.669794] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: IN_PROGRESS for 2s [ 1313.680330] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: SUCCESS [ 1313.680696] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.680762] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.680942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.681185] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.681354] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.681354] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.681514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.681594] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.681677] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.681766] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.116396] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1314.116589] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1314.184083] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.686114] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78ee5c7f-abf9-47ad-98da-200bfacc0aeb: rpc.has_security_group_logging(os_id): False [ 1314.704225] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.704456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.704456] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.704646] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.704736] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.704984] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.705097] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.705161] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.705312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.705446] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.705500] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb is going to be updated. [ 1314.766291] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.766527] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.766527] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.766691] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.766833] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.778419] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: IN_PROGRESS for 2s [ 1316.794069] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: SUCCESS [ 1316.794469] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.117368] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1319.117721] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1324.118410] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1324.118775] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1329.119878] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1329.120330] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1329.583714] env[66519]: INFO networking_nsxv3.common.synchronization [req-7a2305c8-844a-4561-bf42-660ded4f63f8 req-7ebfa6f0-9ff9-4e63-9cb0-94ac4588f99f tempest-ServerDiskConfigTestJSON-286086519 tempest-ServerDiskConfigTestJSON-286086519-project-member] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1329.584273] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1329.584579] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.584704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.584766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.584966] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.585128] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.585224] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.585284] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.585429] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.585507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.585599] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.087761] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.087996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.087996] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.088371] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.088656] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.088779] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.088881] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.088964] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.089162] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.089276] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.089381] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be updated. [ 1330.118829] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.118829] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.119093] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.119135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.119367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.128904] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1332.140860] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1332.141107] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c deletion is rescheduled due to dependency. [ 1332.141216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.451164] env[66519]: INFO networking_nsxv3.common.synchronization [req-3cd2c375-4436-43e5-879d-c4ecef4189d4 req-8e54d88e-c0e5-4502-b3b5-a055dcc7224e tempest-ServerDiskConfigTestJSON-286086519 tempest-ServerDiskConfigTestJSON-286086519-project-member] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1332.451798] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1332.452275] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.452275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.452366] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.452529] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.452674] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.452769] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.452825] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.452990] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.453086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.453186] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.720061] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock network-993 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.720061] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.720061] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.720061] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.720484] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.720484] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.720484] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.720687] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.720743] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.720918] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1332.721031] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1332.721137] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1332.721240] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1332.721396] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1332.721522] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1332.721687] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1332.740575] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1332.740774] env[66519]: DEBUG dogpile.cache.region [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1332.740849] env[66519]: DEBUG dogpile.lock [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1332.741087] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "network-993" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.741500] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock port-12f5dcf8-0bfa-42ee-a131-4096475a6f1d taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.741678] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "port-12f5dcf8-0bfa-42ee-a131-4096475a6f1d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.741859] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "port-12f5dcf8-0bfa-42ee-a131-4096475a6f1d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.742194] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "port-12f5dcf8-0bfa-42ee-a131-4096475a6f1d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.742345] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12f5dcf8-0bfa-42ee-a131-4096475a6f1d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.956126] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.956269] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.956344] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.956584] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.956677] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.956876] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.956973] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.957045] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.957195] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.957272] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.957352] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be updated. [ 1333.009244] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.009398] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.009469] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.009681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.009818] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.019348] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1333.244714] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.245056] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.245056] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.245395] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.245485] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.246043] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Segment Port 12f5dcf8-0bfa-42ee-a131-4096475a6f1d not found, creating... [ 1333.246043] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.246043] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.246249] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.246320] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.246455] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.246726] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.246877] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.246992] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.247212] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.247345] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.247482] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Resource: SegmentPort with ID: 12f5dcf8-0bfa-42ee-a131-4096475a6f1d is going to be created. [ 1333.268559] env[66519]: DEBUG networking_nsxv3.common.locking [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.268770] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.268893] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.269189] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.269471] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.269771] env[66519]: DEBUG oslo_concurrency.lockutils [None req-c39119bb-cf20-4790-ad73-c4cfe0245950 None None] Releasing lock "port-12f5dcf8-0bfa-42ee-a131-4096475a6f1d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.969198] env[66519]: INFO networking_nsxv3.common.synchronization [req-3cd2c375-4436-43e5-879d-c4ecef4189d4 req-e897a39c-5e16-4dd2-9307-9a1568c8757a service nova] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_rules [ 1333.969457] env[66519]: INFO networking_nsxv3.common.synchronization [req-3cd2c375-4436-43e5-879d-c4ecef4189d4 req-e897a39c-5e16-4dd2-9307-9a1568c8757a service nova] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1333.969597] env[66519]: INFO networking_nsxv3.common.synchronization [req-3cd2c375-4436-43e5-879d-c4ecef4189d4 req-e897a39c-5e16-4dd2-9307-9a1568c8757a service nova] Enqueued Resource ID: 12f5dcf8-0bfa-42ee-a131-4096475a6f1d with Priority: HIGHEST for action port [ 1333.971047] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_rules [ 1333.971232] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1333.971415] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f5dcf8-0bfa-42ee-a131-4096475a6f1d with Priority: HIGHEST for action port [ 1333.971733] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.971886] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.971976] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.972229] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.972320] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.973725] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.973822] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.974928] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-12f5dcf8-0bfa-42ee-a131-4096475a6f1d taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.975067] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12f5dcf8-0bfa-42ee-a131-4096475a6f1d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.975131] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12f5dcf8-0bfa-42ee-a131-4096475a6f1d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.975317] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12f5dcf8-0bfa-42ee-a131-4096475a6f1d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.975390] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12f5dcf8-0bfa-42ee-a131-4096475a6f1d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.477254] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.477653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.477653] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12f5dcf8-0bfa-42ee-a131-4096475a6f1d with status ACTIVE [ 1334.477750] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.477880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.477880] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.478306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.478306] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.478306] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.478508] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.478508] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.478605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.478675] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.478858] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.478955] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.479451] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.480068] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.480068] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.480068] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12f5dcf8-0bfa-42ee-a131-4096475a6f1d is going to be updated. [ 1334.501670] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.501670] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.501896] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.501934] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.502319] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.502319] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12f5dcf8-0bfa-42ee-a131-4096475a6f1d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.029277] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1335.029464] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c deletion is rescheduled due to dependency. [ 1335.029576] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.029731] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.030044] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.030189] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.030308] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.030371] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.030534] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.030616] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.030711] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.533334] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.035149] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.537808] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.538143] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.538143] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.538308] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.538399] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.538502] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be updated. [ 1336.572802] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1336.572969] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1336.573023] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1336.573244] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1336.573402] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1336.583936] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1338.595326] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1338.595728] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.595728] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.595929] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.596131] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.596245] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.596316] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.596480] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.596578] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.596666] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.596772] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.972231] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1338.972495] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1339.099332] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.099574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.099574] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.099746] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.099930] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.100050] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.100118] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.100443] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.100552] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.100655] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.100843] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.100951] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.101029] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.101187] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.101330] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.101496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.101557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.101694] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.101773] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.101857] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.101943] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.603765] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b8cccb8-611f-4a20-9af8-d97d565c774c: rpc.has_security_group_logging(os_id): False [ 1339.620633] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.620819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.620819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.620994] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.621101] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.621346] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.621477] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.621544] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.621704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.621780] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.621966] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.622074] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.622135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.622271] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.622343] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.622522] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.622614] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.622681] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.622844] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.622918] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.623021] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be updated. [ 1339.680828] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.681065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.681065] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.681257] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.681437] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.694765] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1341.712207] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1341.712538] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.737653] env[66519]: INFO networking_nsxv3.common.synchronization [req-470fa2fe-3c30-427d-9820-832288720b3f req-6ec00da6-b5fd-4387-8d46-a576f5ff3ec6 tempest-ServerDiskConfigTestJSON-286086519 tempest-ServerDiskConfigTestJSON-286086519-project-member] Enqueued Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1343.737653] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c with Priority: HIGHEST for action security_group_members [ 1343.737653] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b8cccb8-611f-4a20-9af8-d97d565c774c taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.737653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.737653] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.740052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.740052] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.740052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.740052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.740052] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.740332] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.740332] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b8cccb8-611f-4a20-9af8-d97d565c774c',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.243483] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.243483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.243483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.243483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.243483] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.243483] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.243850] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.243850] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.243850] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.243850] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.243984] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c is going to be updated. [ 1344.275063] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.275256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.275256] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.275462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.275609] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.284762] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: IN_PROGRESS for 2s [ 1346.295564] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c in Status: SUCCESS [ 1346.296188] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b8cccb8-611f-4a20-9af8-d97d565c774c deletion is rescheduled due to dependency. [ 1346.296188] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b8cccb8-611f-4a20-9af8-d97d565c774c" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.737734] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1348.738218] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1352.185746] env[66519]: INFO networking_nsxv3.common.synchronization [None req-2945b189-d7fe-4584-acd9-a0296b04df85 None None] Enqueued Resource ID: 895bad47-9493-4377-b29d-8e95cd3a54f3 with Priority: HIGHEST for action port [ 1352.186024] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 895bad47-9493-4377-b29d-8e95cd3a54f3 with Priority: HIGHEST for action port [ 1352.186615] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-895bad47-9493-4377-b29d-8e95cd3a54f3 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.186709] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-895bad47-9493-4377-b29d-8e95cd3a54f3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.186781] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-895bad47-9493-4377-b29d-8e95cd3a54f3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.187135] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-895bad47-9493-4377-b29d-8e95cd3a54f3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.187411] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('895bad47-9493-4377-b29d-8e95cd3a54f3',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.689695] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 895bad47-9493-4377-b29d-8e95cd3a54f3 [ 1352.689828] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.690442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.690442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.690442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.690442] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.690654] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:895bad47-9493-4377-b29d-8e95cd3a54f3 already deleted. [ 1352.690654] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-895bad47-9493-4377-b29d-8e95cd3a54f3" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.973055] env[66519]: INFO networking_nsxv3.common.synchronization [None req-2844139d-f4ce-4c47-9e52-1510f12be71d None None] Enqueued Resource ID: 14da146a-6e4d-43d9-a8aa-3df423ff9f1a with Priority: HIGHEST for action port [ 1353.973055] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14da146a-6e4d-43d9-a8aa-3df423ff9f1a with Priority: HIGHEST for action port [ 1353.973055] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-14da146a-6e4d-43d9-a8aa-3df423ff9f1a taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.973055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14da146a-6e4d-43d9-a8aa-3df423ff9f1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.973055] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14da146a-6e4d-43d9-a8aa-3df423ff9f1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.975700] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14da146a-6e4d-43d9-a8aa-3df423ff9f1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.975700] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14da146a-6e4d-43d9-a8aa-3df423ff9f1a',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.476190] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14da146a-6e4d-43d9-a8aa-3df423ff9f1a [ 1354.476535] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.476605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.476685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.476862] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.476956] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.477062] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14da146a-6e4d-43d9-a8aa-3df423ff9f1a already deleted. [ 1354.477145] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14da146a-6e4d-43d9-a8aa-3df423ff9f1a" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.248863] env[66519]: INFO networking_nsxv3.common.synchronization [req-d7214890-0a55-4eb7-aa42-785f101b6f36 req-601923ff-635c-4c63-a34d-21544c96a5c3 tempest-InstanceActionsNegativeTestJSON-872598948 tempest-InstanceActionsNegativeTestJSON-872598948-project-member] Enqueued Resource ID: 46698a00-4791-4130-b37d-d6f17c3a7640 with Priority: HIGHEST for action security_group_members [ 1357.249482] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46698a00-4791-4130-b37d-d6f17c3a7640 with Priority: HIGHEST for action security_group_members [ 1357.249822] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-46698a00-4791-4130-b37d-d6f17c3a7640 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.249981] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.250105] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.250450] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.250639] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.250766] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.250816] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.250967] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.251068] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.251161] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46698a00-4791-4130-b37d-d6f17c3a7640',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.542491] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock network-473 taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.542812] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "network-473" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.543037] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "network-473" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.543506] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "network-473" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.543910] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.544160] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.544339] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.544660] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.544865] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.545160] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1357.545326] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] NeedRegenerationException {{(pid=66519) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1357.545488] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] no value, waiting for create lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1357.545958] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] value creation lock acquired {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1357.545958] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] No value present for key: 'zone-id' {{(pid=66519) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1357.545958] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Calling creation function for not-yet-present value {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1357.546157] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1357.570080] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1357.570080] env[66519]: DEBUG dogpile.cache.region [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66519) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1357.570080] env[66519]: DEBUG dogpile.lock [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Released creation lock {{(pid=66519) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1357.570080] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "network-473" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.570389] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock port-05ed8815-92ae-454f-93a9-980eafcb9c6d taken with stack trace [, , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.570389] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "port-05ed8815-92ae-454f-93a9-980eafcb9c6d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.570501] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "port-05ed8815-92ae-454f-93a9-980eafcb9c6d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.570915] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "port-05ed8815-92ae-454f-93a9-980eafcb9c6d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.571076] env[66519]: DEBUG networking_nsxv3.api.rpc [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05ed8815-92ae-454f-93a9-980eafcb9c6d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.754448] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.754605] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.754684] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.754898] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.754992] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.755205] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.755311] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.755367] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.755514] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.755588] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.755752] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46698a00-4791-4130-b37d-d6f17c3a7640 already deleted. [ 1357.755752] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.074040] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.074345] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.074512] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.074896] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.075104] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.075317] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Segment Port 05ed8815-92ae-454f-93a9-980eafcb9c6d not found, creating... [ 1358.075708] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.075963] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.076109] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.076335] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.076469] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.076746] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.076900] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.077036] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.077245] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.077374] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.077509] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Resource: SegmentPort with ID: 05ed8815-92ae-454f-93a9-980eafcb9c6d is going to be created. [ 1358.100090] env[66519]: DEBUG networking_nsxv3.common.locking [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.100382] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.100449] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.100682] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.100900] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.101132] env[66519]: DEBUG oslo_concurrency.lockutils [None req-1b060379-ace2-4c83-ab99-064e7ce06b4d None None] Releasing lock "port-05ed8815-92ae-454f-93a9-980eafcb9c6d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.259950] env[66519]: INFO networking_nsxv3.common.synchronization [req-d7214890-0a55-4eb7-aa42-785f101b6f36 req-de4436f4-a0bd-48da-89ad-f71541750727 service nova] Enqueued Resource ID: 46698a00-4791-4130-b37d-d6f17c3a7640 with Priority: HIGHEST for action security_group_rules [ 1359.260259] env[66519]: INFO networking_nsxv3.common.synchronization [req-d7214890-0a55-4eb7-aa42-785f101b6f36 req-de4436f4-a0bd-48da-89ad-f71541750727 service nova] Enqueued Resource ID: 46698a00-4791-4130-b37d-d6f17c3a7640 with Priority: HIGHEST for action security_group_members [ 1359.260259] env[66519]: INFO networking_nsxv3.common.synchronization [req-d7214890-0a55-4eb7-aa42-785f101b6f36 req-de4436f4-a0bd-48da-89ad-f71541750727 service nova] Enqueued Resource ID: 05ed8815-92ae-454f-93a9-980eafcb9c6d with Priority: HIGHEST for action port [ 1359.260771] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46698a00-4791-4130-b37d-d6f17c3a7640 with Priority: HIGHEST for action security_group_rules [ 1359.260905] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46698a00-4791-4130-b37d-d6f17c3a7640 with Priority: HIGHEST for action security_group_members [ 1359.261009] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ed8815-92ae-454f-93a9-980eafcb9c6d with Priority: HIGHEST for action port [ 1359.261418] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock rules-46698a00-4791-4130-b37d-d6f17c3a7640 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.261542] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.261650] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.261902] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.261991] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('46698a00-4791-4130-b37d-d6f17c3a7640',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.262881] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-46698a00-4791-4130-b37d-d6f17c3a7640 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.263045] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.263117] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.263287] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.263432] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.263603] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.263671] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.264829] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.264829] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.264829] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46698a00-4791-4130-b37d-d6f17c3a7640',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.265058] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock port-05ed8815-92ae-454f-93a9-980eafcb9c6d taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.265917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05ed8815-92ae-454f-93a9-980eafcb9c6d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.265917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05ed8815-92ae-454f-93a9-980eafcb9c6d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.265917] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05ed8815-92ae-454f-93a9-980eafcb9c6d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.265917] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05ed8815-92ae-454f-93a9-980eafcb9c6d',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.768121] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05ed8815-92ae-454f-93a9-980eafcb9c6d with status ACTIVE [ 1359.768336] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.768463] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.768535] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.768763] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.768856] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.769059] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.769163] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.769223] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.769375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.769450] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.769650] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.769755] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.769803] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.769942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.770021] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.770104] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05ed8815-92ae-454f-93a9-980eafcb9c6d is going to be updated. [ 1359.771189] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('46698a00-4791-4130-b37d-d6f17c3a7640',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.772112] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-46698a00-4791-4130-b37d-d6f17c3a7640 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.772242] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.793044] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.793247] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.793247] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.793420] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.793557] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.793712] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05ed8815-92ae-454f-93a9-980eafcb9c6d" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.273285] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('46698a00-4791-4130-b37d-d6f17c3a7640',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.776361] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.776523] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.776581] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.776801] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.776891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.776983] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46698a00-4791-4130-b37d-d6f17c3a7640 is going to be created. [ 1360.799989] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.800235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.800235] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.800409] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.800590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.809893] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46698a00-4791-4130-b37d-d6f17c3a7640 in Status: UNINITIALIZED for 2s [ 1362.820925] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46698a00-4791-4130-b37d-d6f17c3a7640 in Status: SUCCESS [ 1362.821379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.821379] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.821496] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.821796] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.821942] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.822030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.822227] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.822330] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.822462] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.822593] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('46698a00-4791-4130-b37d-d6f17c3a7640',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.325446] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-46698a00-4791-4130-b37d-d6f17c3a7640 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.325704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.325704] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.325924] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.326111] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.326216] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.326275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.326421] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.326504] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.326590] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.326730] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-46698a00-4791-4130-b37d-d6f17c3a7640 taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.326835] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.326895] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.327047] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.327183] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.327270] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.327327] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.327466] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.327528] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.327612] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.327694] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('46698a00-4791-4130-b37d-d6f17c3a7640',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.830440] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 46698a00-4791-4130-b37d-d6f17c3a7640: rpc.has_security_group_logging(os_id): False [ 1363.850507] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.850507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.850507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.850507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.850507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.850507] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.850507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.850507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.850507] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.851107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.851107] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.851107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.851107] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.851275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.851275] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.851475] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.851578] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.851714] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.851895] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.851960] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.852057] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 46698a00-4791-4130-b37d-d6f17c3a7640 is going to be created. [ 1363.920425] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.920688] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.920688] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.920834] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.921016] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.932711] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46698a00-4791-4130-b37d-d6f17c3a7640 in Status: IN_PROGRESS for 2s [ 1364.262840] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.263071] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1365.946729] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 46698a00-4791-4130-b37d-d6f17c3a7640 in Status: SUCCESS [ 1365.946729] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.263961] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1369.264312] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1369.472407] env[66519]: INFO networking_nsxv3.common.synchronization [req-051195b0-dea8-4aa3-8d94-5f3ef655a209 req-14933294-217d-407b-ab64-c91602efc104 tempest-InstanceActionsNegativeTestJSON-872598948 tempest-InstanceActionsNegativeTestJSON-872598948-project-member] Enqueued Resource ID: 46698a00-4791-4130-b37d-d6f17c3a7640 with Priority: HIGHEST for action security_group_members [ 1369.473383] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46698a00-4791-4130-b37d-d6f17c3a7640 with Priority: HIGHEST for action security_group_members [ 1369.473383] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-46698a00-4791-4130-b37d-d6f17c3a7640 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.474030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.474030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.474030] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.474030] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.474397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.474397] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.474489] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.474524] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.474635] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('46698a00-4791-4130-b37d-d6f17c3a7640',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.976634] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.976819] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.976891] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.977173] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.977281] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.977480] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.977584] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.977648] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.977811] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.977888] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.977972] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46698a00-4791-4130-b37d-d6f17c3a7640 is going to be updated. [ 1370.005546] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.005770] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.005770] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.006019] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.006236] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.015316] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46698a00-4791-4130-b37d-d6f17c3a7640 in Status: IN_PROGRESS for 2s [ 1370.963559] env[66519]: INFO networking_nsxv3.common.synchronization [req-68243acc-a3cd-4ad0-bef6-8aa7b634b0bc req-bb4903c3-9698-455b-ad22-90eb05fa5c75 tempest-ServerActionsTestJSON-1487893254 tempest-ServerActionsTestJSON-1487893254-project-member] Enqueued Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_members [ 1370.964403] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb with Priority: HIGHEST for action security_group_members [ 1370.964758] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.964954] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.965070] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.965300] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.965450] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.965597] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.965685] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.965927] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.966086] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.966243] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78ee5c7f-abf9-47ad-98da-200bfacc0aeb',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1371.469978] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.469978] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.470337] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.470337] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.470475] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.470701] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.470830] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.470906] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.471126] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.471222] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.471356] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb is going to be updated. [ 1371.515693] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1371.515845] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1371.515915] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1371.516131] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1371.516273] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1371.525938] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: IN_PROGRESS for 2s [ 1372.024814] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 46698a00-4791-4130-b37d-d6f17c3a7640 in Status: SUCCESS [ 1372.025205] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 46698a00-4791-4130-b37d-d6f17c3a7640 deletion is rescheduled due to dependency. [ 1372.025205] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-46698a00-4791-4130-b37d-d6f17c3a7640" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.246539] env[66519]: INFO networking_nsxv3.common.synchronization [req-119aca23-73a6-45ad-8ed5-a1c18d1d57c2 req-bb3203f0-dba6-4ba6-ba2a-bd12a78fce70 tempest-AttachVolumeTestJSON-862216491 tempest-AttachVolumeTestJSON-862216491-project-member] Enqueued Resource ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 with Priority: HIGHEST for action security_group_members [ 1372.247127] env[66519]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 with Priority: HIGHEST for action security_group_members [ 1372.247439] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 taken with stack trace [, , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.247610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.247610] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.247835] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.247955] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.248067] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.248134] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.248258] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.248331] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.248752] env[66519]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('136ea30a-78ce-4fb9-9ed2-fbb65b2c7293',) {} {{(pid=66519) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1372.751178] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.751375] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.751417] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.751612] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.751783] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.751970] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.752085] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.752148] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.752312] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.752388] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.752473] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 is going to be updated. [ 1372.779061] env[66519]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66519) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.779262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.779262] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.779471] env[66519]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.779636] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.787622] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 in Status: IN_PROGRESS for 2s [ 1373.537346] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb in Status: SUCCESS [ 1373.537716] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78ee5c7f-abf9-47ad-98da-200bfacc0aeb deletion is rescheduled due to dependency. [ 1373.537769] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78ee5c7f-abf9-47ad-98da-200bfacc0aeb" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.800058] env[66519]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 in Status: SUCCESS [ 1374.800398] env[66519]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 136ea30a-78ce-4fb9-9ed2-fbb65b2c7293 deletion is rescheduled due to dependency. [ 1374.800398] env[66519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-136ea30a-78ce-4fb9-9ed2-fbb65b2c7293" {{(pid=66519) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.247940] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1377.248236] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1382.248765] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1382.249211] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1387.250568] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1387.250568] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1392.251870] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.252240] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.253268] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.253268] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1402.253856] env[66519]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.254247] env[66519]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0